-- Logs begin at Thu 2022-06-30 09:41:36 UTC, end at Thu 2022-06-30 10:40:17 UTC. -- Jun 30 10:07:47.698266 dv-cinder-826608-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 30 10:07:47.710149 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 10:07:47 2022] *** Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: nodename: dv-cinder-826608-4-iscsi Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: machine: x86_64 Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: clock source: unix Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: pcre jit disabled Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: detected number of CPU cores: 4 Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: current working directory: / Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: detected binary path: /usr/bin/uwsgi-core Jun 30 10:07:47.712225 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: your processes number limit is 47680 Jun 30 10:07:47.712919 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: your memory page size is 4096 bytes Jun 30 10:07:47.712919 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: detected max file descriptor number: 2048 Jun 30 10:07:47.712919 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: lock engine: pthread robust mutexes Jun 30 10:07:47.712919 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: thunder lock: enabled Jun 30 10:07:47.712919 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 30 10:07:47.712919 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 10:07:47.755351 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: Python main interpreter initialized at 0x5634143749c0 Jun 30 10:07:47.755351 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: python threads support enabled Jun 30 10:07:47.755351 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: your server socket listen backlog is limited to 100 connections Jun 30 10:07:47.755351 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: your mercy for graceful operations on workers is 90 seconds Jun 30 10:07:47.755666 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 10:07:47.755739 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: *** Operational MODE: preforking *** Jun 30 10:07:47.755973 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: *** uWSGI is running in multiple interpreter mode *** Jun 30 10:07:47.755973 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: spawned uWSGI master process (pid: 80014) Jun 30 10:07:47.756171 dv-cinder-826608-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 30 10:07:47.757139 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: spawned uWSGI worker 1 (pid: 80025, cores: 1) Jun 30 10:07:47.757139 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: spawned uWSGI worker 2 (pid: 80026, cores: 1) Jun 30 10:07:47.758605 dv-cinder-826608-4-iscsi devstack@keystone.service[80014]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 10:07:53.162983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:07:53.162983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: from cryptography.utils import int_from_bytes Jun 30 10:07:53.163766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:07:53.163766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: from cryptography.utils import int_from_bytes Jun 30 10:07:53.164031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:07:53.164031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: from cryptography.utils import int_from_bytes Jun 30 10:07:53.164475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 10:07:53.164475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: from cryptography.utils import int_from_bytes Jun 30 10:07:53.213135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:07:53.213326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:07:53.213497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 10:07:53.213593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] command line args: [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:07:53.213695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 10:07:53.213775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:07:53.213891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] command line args: [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 10:07:53.213970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ================================================================================ {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:07:53.214160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 10:07:53.214239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] admin_token = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.214338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ================================================================================ {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 10:07:53.214423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] config_dir = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.214570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.214653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] admin_token = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.214781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] config_source = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.214866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] config_dir = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.214969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] debug = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] config_source = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] debug = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.215977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] list_limit = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] log_config_append = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] list_limit = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.216953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] log_config_append = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.217060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] log_dir = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.217162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.217262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] log_file = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.217369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] log_dir = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.217762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.217849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] log_file = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.217964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.218993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.219934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.220869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] publish_errors = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] publish_errors = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.221958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] standard_threads = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.222924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] standard_threads = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] use_journal = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.223909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] use_json = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] use_journal = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] use_stderr = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] use_json = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] use_syslog = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] use_stderr = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] use_syslog = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.224848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.224968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 10:07:53.225087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.225208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.225339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.225491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.225607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.225724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.225836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.225957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.226888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.227926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.228997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.229926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.230959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.231996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.232801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.233943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.234972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.235913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.236945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.237895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.238948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.239909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.240964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.241987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.242975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.243901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.244943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.245941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.246995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.247822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248743 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.248971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] auth.external = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] auth.external = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.249875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] auth.password = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] auth.token = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.250909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] auth.password = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] auth.token = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.251975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] credential.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.252892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] credential.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.253954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.254913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.255972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.256901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.257943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.258913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.259029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.259144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.259789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.259925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260114 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260692 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.260928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.261972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.262942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.263886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.264927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265726 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265841 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.265956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.266900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.267939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.268972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.269905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.270993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.271943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272174 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.272985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.273208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.273324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.273438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.273553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.273667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.273781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.273904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.274848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.275538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.275660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.275775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.275908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276026 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.276957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.277890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.278967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.279894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.280950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.281998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.282115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.282238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.282354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.282469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.282584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.282752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.282871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] role.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] role.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.283885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] role.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] role.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284586 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.284931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.285985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286455 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.286926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.287987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.288902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.289953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.290953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.291885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.292937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.293988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.294958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.connection = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.295911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296026 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.connection = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.296981 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.297912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.298987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:07:53.299787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 10:07:53.299787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 10:07:53.327656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.327877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.327977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.328107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.328194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.328364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.336537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.336702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.364854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.365081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.365163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.365319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.507021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.507266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.556777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.557009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.557120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.557321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.622961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.623092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.623177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.623304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.648166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.648419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.648526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.648667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.648752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.648890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.648973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.649106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.649191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.649319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.649401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.649532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.649615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.649761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.660606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.660919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.673250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.673511 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.673668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.673754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.673899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.673983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.674121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.674211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.674340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.674423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.674554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.674643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.674799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.675013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80025) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 10:07:53.692454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.692605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.692690 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:07:53.693067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:07:53.693234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.693401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.693483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:07:53.693600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 10:07:53.693682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.693865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.693957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.694124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.694206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.694379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.694459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.694630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.705705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.705979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.706061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.706245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.706328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.706522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.706606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.706847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.714801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.715127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.718067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.718341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.718775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.719252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.719336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.719530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.719746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.719827 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.720075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.720221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.720356 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.720612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.720693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.720886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.720969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.721158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.721362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.721446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.721689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.721850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.722317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.722836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.748998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.750562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.750858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.751478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.753089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.753366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.756078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.756353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.756742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.758620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.758919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.759370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.764535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.764810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.767156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.767438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.769258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.769540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.769817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.770096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.770366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.770639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.770928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.771192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.771927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.772210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.772488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.772768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.773041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.773311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.773575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.773836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.789709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.789980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.792691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.792966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.794760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.797670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.798366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.798653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.802707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.803213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.803759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.807876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.809942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.811520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.811814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.812092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.812372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.812662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.812947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.813566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.817246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.817544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.818075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.818361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.818653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.818957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.832709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.832988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.833252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.833511 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.838586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.838891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.839159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.839421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.841479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.843268 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.843540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.846857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.847136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.847358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.847442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.847686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.847965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.849067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.849344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.852607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.852887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.853191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.853573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.853854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.861133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.861408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.861691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.861967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.862245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.863844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.864142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.867126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.867403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.867683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.867962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.868251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.870353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.870663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.883105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.886973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.889027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.890272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.892033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.892305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.893657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.893933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.894209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.895647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.897399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.899041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.899318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.899595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.901530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.903163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.906360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.906651 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.906959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.907045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.907329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.908562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.911814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.912104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.912492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.912773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.916392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.916675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.916958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.921909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.922189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.922467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.924791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.925066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.925340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.925607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.925870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.926234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.926516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.926810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.927097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.927371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.927645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.927902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.928163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.928434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.930363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80025) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 10:07:53.930645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.930947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.931741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.932010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.932388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.932672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.932942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.933226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.933497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.933765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.934027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.934298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.934562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80025) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 10:07:53.967343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634143749c0 pid: 80026 (default app) Jun 30 10:07:53.970772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554291-dfe6-412b-aa92-e01fb50655d8 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:07:53.971070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554291-dfe6-412b-aa92-e01fb50655d8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:07:53.971345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554291-dfe6-412b-aa92-e01fb50655d8 None None] PATH_INFO: `/v3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:07:53.973162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634143749c0 pid: 80025 (default app) Jun 30 10:07:53.975524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Thu Jun 30 10:07:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:01.592318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da4fe-2f96-4bc9-a32d-72ed85828c32 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:01.592848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da4fe-2f96-4bc9-a32d-72ed85828c32 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:01.592848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217da4fe-2f96-4bc9-a32d-72ed85828c32 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:01.597158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:01.602269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:01.602731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:01.602859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:01.672001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: INFO dbcounter [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] Registered counter for database keystone Jun 30 10:08:01.692677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG oslo_db.sqlalchemy.engines [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:08:01.699634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writer thread running {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:08:01.875516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG passlib.handlers.bcrypt [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80026) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 10:08:01.875861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG passlib.handlers.bcrypt [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80026) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 10:08:01.929438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:01.931095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:02.052528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 10:08:02.270663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217da4fe-2f96-4bc9-a32d-72ed85828c32 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:02.341392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: INFO dbcounter [None req-217da4fe-2f96-4bc9-a32d-72ed85828c32 None None] Registered counter for database keystone Jun 30 10:08:02.360407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG oslo_db.sqlalchemy.engines [None req-217da4fe-2f96-4bc9-a32d-72ed85828c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 10:08:02.366604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writer thread running {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 10:08:02.493560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217da4fe-2f96-4bc9-a32d-72ed85828c32 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:02.497957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e33b-97d8-49ad-8f7f-845436b88e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:02.498632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e33b-97d8-49ad-8f7f-845436b88e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:02.498941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e33b-97d8-49ad-8f7f-845436b88e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:02.499219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e33b-97d8-49ad-8f7f-845436b88e88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:02.507290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9e33b-97d8-49ad-8f7f-845436b88e88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:02.560044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING keystone.common.rbac_enforcer.enforcer [None req-53e9e33b-97d8-49ad-8f7f-845436b88e88 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 10:08:02.560328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9e33b-97d8-49ad-8f7f-845436b88e88 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:02.569956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Thu Jun 30 10:08:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 10:08:02.576392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:02.591622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce362919-0d96-4fac-b0e2-922171a6cf82 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:02.596000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbecb3-4324-4734-8166-b3b551d5413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:02.597110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbecb3-4324-4734-8166-b3b551d5413d admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:02.597394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbecb3-4324-4734-8166-b3b551d5413d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:02.597669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbecb3-4324-4734-8166-b3b551d5413d admin admin] PATH_INFO: `/v3/projects/9982519b09d14f298a1a1f477137a258` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:02.601725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbecb3-4324-4734-8166-b3b551d5413d admin admin] RBAC: Authorizing `identity:get_project(project_id=9982519b09d14f298a1a1f477137a258)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:02.652786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9cbecb3-4324-4734-8166-b3b551d5413d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 10:08:02.653315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbecb3-4324-4734-8166-b3b551d5413d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:02.657617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Thu Jun 30 10:08:02 2022] GET /identity/v3/projects/9982519b09d14f298a1a1f477137a258 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:04.627279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66bec-9d51-4c35-9ba2-cb2a4e6ec99a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:04.627757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66bec-9d51-4c35-9ba2-cb2a4e6ec99a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:04.627855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66bec-9d51-4c35-9ba2-cb2a4e6ec99a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:04.631902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:04.637192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e268-fcfd-470e-bf88-30012afb37ed None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:04.637565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e268-fcfd-470e-bf88-30012afb37ed None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:04.637742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e268-fcfd-470e-bf88-30012afb37ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:04.656336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-dd86e268-fcfd-470e-bf88-30012afb37ed None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:04.657856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dd86e268-fcfd-470e-bf88-30012afb37ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:04.665708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 10:08:04.688531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66bec-9d51-4c35-9ba2-cb2a4e6ec99a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:04.703774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66bec-9d51-4c35-9ba2-cb2a4e6ec99a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:04.708040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca69b-e046-4711-95e0-4435c0d632ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:04.708670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca69b-e046-4711-95e0-4435c0d632ed admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:04.708959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca69b-e046-4711-95e0-4435c0d632ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:04.709238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca69b-e046-4711-95e0-4435c0d632ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:04.716934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca69b-e046-4711-95e0-4435c0d632ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:04.718713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca69b-e046-4711-95e0-4435c0d632ed admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:04.727467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Thu Jun 30 10:08:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:08:04.733081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e268-fcfd-470e-bf88-30012afb37ed None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:04.742039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e268-fcfd-470e-bf88-30012afb37ed None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:04.747162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bb916-7c2b-46f5-98ce-5ffa8b9de17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:04.748013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bb916-7c2b-46f5-98ce-5ffa8b9de17d admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:04.748299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bb916-7c2b-46f5-98ce-5ffa8b9de17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:04.748577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bb916-7c2b-46f5-98ce-5ffa8b9de17d admin admin] PATH_INFO: `/v3/users/810ff4bb01dd49c79c0fe9e258d450e7` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:04.749968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bb916-7c2b-46f5-98ce-5ffa8b9de17d admin admin] RBAC: Authorizing `identity:get_user(user_id=810ff4bb01dd49c79c0fe9e258d450e7)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:04.751835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bb916-7c2b-46f5-98ce-5ffa8b9de17d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:04.753385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Thu Jun 30 10:08:04 2022] GET /identity/v3/users/810ff4bb01dd49c79c0fe9e258d450e7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:06.838135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc75f5b-0d66-4077-90dd-c8fddb6c684c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:06.838637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc75f5b-0d66-4077-90dd-c8fddb6c684c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:06.838637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc75f5b-0d66-4077-90dd-c8fddb6c684c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:06.840006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:06.845056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22b4bc-ca96-4f63-8c72-427c87db53ef None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:06.845469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22b4bc-ca96-4f63-8c72-427c87db53ef None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:06.845622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22b4bc-ca96-4f63-8c72-427c87db53ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:06.853943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dad37-38b1-44c6-88d1-0eafcc6ee49b None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:06.854235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dad37-38b1-44c6-88d1-0eafcc6ee49b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:06.854519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dad37-38b1-44c6-88d1-0eafcc6ee49b None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:06.855868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:06.861047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:06.861341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:06.861626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:06.862710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4f22b4bc-ca96-4f63-8c72-427c87db53ef None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:06.863893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4f22b4bc-ca96-4f63-8c72-427c87db53ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:06.901178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG passlib.handlers.bcrypt [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80025) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 10:08:06.901610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG passlib.handlers.bcrypt [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80025) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 10:08:06.944093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:06.947886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:06.949504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:06.966766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22b4bc-ca96-4f63-8c72-427c87db53ef None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:06.989997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:07.048709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:07.069499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22b4bc-ca96-4f63-8c72-427c87db53ef None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.071396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:07.105072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.105800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.106092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.106375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.118178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:07.129378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:07.130306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:07.131177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:07.136197 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:07.174596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4a771-9a0d-4adc-8a46-328cc491d361 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.176934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:07.212375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.213806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.214091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.214369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.217966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:07.240310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc86e3-803f-4c8f-bc9b-63ba672a90a7 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.274970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.276178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.276465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.276751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.277506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:07.277816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:07.279257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:07.284138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:07.285668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:07.291720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:07.297215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:07.387397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:07.392995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:07.395653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:07.399135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9005-990b-4797-b007-19bbd3cd0ce0 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.436811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.437688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.437978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.438258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] PATH_INFO: `/v3/users/810ff4bb01dd49c79c0fe9e258d450e7` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.439510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] RBAC: Authorizing `identity:get_user(user_id=810ff4bb01dd49c79c0fe9e258d450e7)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:07.440992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:07.442621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:07 2022] GET /identity/v3/users/810ff4bb01dd49c79c0fe9e258d450e7 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:07.448847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:07.462943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:07.493379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6dbe1-7f16-45ae-aad7-0f07ca219db7 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.528088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.528868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.529149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.529424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.548902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d27a3-19e5-4eed-95a0-fa001e7a8227 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.549107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:07.550560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:08:07.573301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:07.574140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:07.574975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:08:07.574975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:08:07.574975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:08:07.574975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:07.574975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 9/18] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:07.580157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:07.586811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.587612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.588438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.588728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.589931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:07.591441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:07.593039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 10/19] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:07.598671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:07.636765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:07.677878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:07.680054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0c380-4d29-4b4b-a226-daaa75ac19fd None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.698057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ccf01-5e7a-44e8-b661-af7bbbe3d269 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:07.713619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652c59b-1ad7-4460-9997-40f0fe0da883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.714267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652c59b-1ad7-4460-9997-40f0fe0da883 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.714562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652c59b-1ad7-4460-9997-40f0fe0da883 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.714865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652c59b-1ad7-4460-9997-40f0fe0da883 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.715594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652c59b-1ad7-4460-9997-40f0fe0da883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:07.715899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652c59b-1ad7-4460-9997-40f0fe0da883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:07.717284 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652c59b-1ad7-4460-9997-40f0fe0da883 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:07.731558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cfafe-b483-4ea5-a42c-ecde47dab0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:07.732208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cfafe-b483-4ea5-a42c-ecde47dab0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:07.732496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cfafe-b483-4ea5-a42c-ecde47dab0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:07.732780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cfafe-b483-4ea5-a42c-ecde47dab0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:07.733611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cfafe-b483-4ea5-a42c-ecde47dab0a5 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.domain.id=default, user.id=810ff4bb01dd49c79c0fe9e258d450e7) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:07.733908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 10/20] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:07.733993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cfafe-b483-4ea5-a42c-ecde47dab0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:07.735383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cfafe-b483-4ea5-a42c-ecde47dab0a5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:07.742610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 11/21] 10.222.0.44 () {56 vars in 1322 bytes} [Thu Jun 30 10:08:07 2022] GET /identity/v3/role_assignments?user.id=810ff4bb01dd49c79c0fe9e258d450e7&scope.domain.id=default&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:10.171649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728febdc-8b84-4b48-bbea-05039b80bedb None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.171649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728febdc-8b84-4b48-bbea-05039b80bedb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.171649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728febdc-8b84-4b48-bbea-05039b80bedb None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.172569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 11/22] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:10.178339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4f00-c3ed-4513-bda0-710e80e1ef86 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.179228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4f00-c3ed-4513-bda0-710e80e1ef86 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.179740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4f00-c3ed-4513-bda0-710e80e1ef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.203643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-283c4f00-c3ed-4513-bda0-710e80e1ef86 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:10.205168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-283c4f00-c3ed-4513-bda0-710e80e1ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:10.285969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 12/23] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:10.325768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728febdc-8b84-4b48-bbea-05039b80bedb None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:10.468173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728febdc-8b84-4b48-bbea-05039b80bedb None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:10.509121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:10.526411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfab902-054d-45a1-a7a8-e489de8a12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:10.527234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab902-054d-45a1-a7a8-e489de8a12d8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.527516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab902-054d-45a1-a7a8-e489de8a12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.527791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab902-054d-45a1-a7a8-e489de8a12d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.547361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfab902-054d-45a1-a7a8-e489de8a12d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:10.548497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfab902-054d-45a1-a7a8-e489de8a12d8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ccfab902-054d-45a1-a7a8-e489de8a12d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:08:10.577680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:10.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:10.579385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:08:10.579385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:08:10.579385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:08:10.579385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:10.579385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 12/24] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:10.585919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c4f00-c3ed-4513-bda0-710e80e1ef86 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:10.721496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:10.721978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57020-e285-417f-9d43-dac7f7033ccc None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.722506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57020-e285-417f-9d43-dac7f7033ccc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.723026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57020-e285-417f-9d43-dac7f7033ccc None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.724658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 13/25] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:10.736099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1cbd-a49f-4041-bbbb-4646924d1d87 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.736897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1cbd-a49f-4041-bbbb-4646924d1d87 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.737400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce1cbd-a49f-4041-bbbb-4646924d1d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.762590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ecce1cbd-a49f-4041-bbbb-4646924d1d87 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:10.764468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ecce1cbd-a49f-4041-bbbb-4646924d1d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:10.782824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c4f00-c3ed-4513-bda0-710e80e1ef86 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:10.825978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd35be-8ada-4f80-9623-a45de56586cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:10.826949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd35be-8ada-4f80-9623-a45de56586cd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.827418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd35be-8ada-4f80-9623-a45de56586cd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.827833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd35be-8ada-4f80-9623-a45de56586cd None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.828703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd35be-8ada-4f80-9623-a45de56586cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:10.829253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd35be-8ada-4f80-9623-a45de56586cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:10.830987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd35be-8ada-4f80-9623-a45de56586cd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:10.841159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 14/26] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:10.847178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1931f9b-2156-4730-9285-4a370b541e2b None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.847683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1931f9b-2156-4730-9285-4a370b541e2b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.848178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1931f9b-2156-4730-9285-4a370b541e2b None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.849671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 15/27] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:10.849948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 13/28] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:10.851097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901187b4-734d-4f2f-be7a-ea787218b433 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.851585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901187b4-734d-4f2f-be7a-ea787218b433 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.852069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901187b4-734d-4f2f-be7a-ea787218b433 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.853513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 16/29] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:10.858966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901187b4-734d-4f2f-be7a-ea787218b433 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:10.859441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3b11-ae5b-4908-9608-f47ee3bf6a77 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.859881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3b11-ae5b-4908-9608-f47ee3bf6a77 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.860310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3b11-ae5b-4908-9608-f47ee3bf6a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:10.890772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-69bf3b11-ae5b-4908-9608-f47ee3bf6a77 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:10.892403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-69bf3b11-ae5b-4908-9608-f47ee3bf6a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:10.963410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:10.965206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 14/30] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:10.970744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901187b4-734d-4f2f-be7a-ea787218b433 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:10.973070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fce7b-b1fa-4e76-96bb-ebaa2c5b48ec None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:10.973515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fce7b-b1fa-4e76-96bb-ebaa2c5b48ec None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:10.973930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fce7b-b1fa-4e76-96bb-ebaa2c5b48ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.002984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f35fce7b-b1fa-4e76-96bb-ebaa2c5b48ec None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:11.004479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f35fce7b-b1fa-4e76-96bb-ebaa2c5b48ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:11.005508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:11.006275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.006694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.007195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.008695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:11.010603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:11.075932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:11.084767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 15/31] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:11.091720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fce7b-b1fa-4e76-96bb-ebaa2c5b48ec None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:11.164978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 17/32] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:08:10 2022] POST /identity/v3/projects => generated 301 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:11.166113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:11.222242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fce7b-b1fa-4e76-96bb-ebaa2c5b48ec None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:11.261834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:11.263004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.263557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.264049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.265037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:11.266880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:11.285431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917fc37-e7b0-4ff3-8f05-678c08bac548 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:11.325995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:11.326727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.327018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.327301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.328159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:11.329804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:11.349062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 18/33] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 30 10:08:11 2022] POST /identity/v3/roles => generated 225 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:11.349891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:11.367164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:11.448009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 16/34] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 30 10:08:11 2022] POST /identity/v3/roles => generated 219 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:11.468398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849d61-9acc-4b3a-9499-25c163ac1b87 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:11.521669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267b03-e2b9-4623-a1f4-acccc769cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:11.522412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267b03-e2b9-4623-a1f4-acccc769cf3b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.522729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267b03-e2b9-4623-a1f4-acccc769cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.523022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267b03-e2b9-4623-a1f4-acccc769cf3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.536762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b267b03-e2b9-4623-a1f4-acccc769cf3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-6b267b03-e2b9-4623-a1f4-acccc769cf3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:11.546629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:11.547548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:11.548285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 19/35] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:11.556015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:11.647362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:11.657494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592bdd9-2695-4d90-b6ff-d104abba90bf None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.657810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592bdd9-2695-4d90-b6ff-d104abba90bf None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.658096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592bdd9-2695-4d90-b6ff-d104abba90bf None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.661506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 20/36] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:11.667367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf653c-2a03-4d4b-bca9-549f598b1185 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.668536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf653c-2a03-4d4b-bca9-549f598b1185 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.668536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf653c-2a03-4d4b-bca9-549f598b1185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.703478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-74cf653c-2a03-4d4b-bca9-549f598b1185 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:11.705086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-74cf653c-2a03-4d4b-bca9-549f598b1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:11.709239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185bc00-02df-41b0-b643-b858bbe2245b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:11.751908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cba8a7-7f86-4d5f-b86b-19bf7d62ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:11.754605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba8a7-7f86-4d5f-b86b-19bf7d62ec53 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.754605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba8a7-7f86-4d5f-b86b-19bf7d62ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.754605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba8a7-7f86-4d5f-b86b-19bf7d62ec53 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.754605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cba8a7-7f86-4d5f-b86b-19bf7d62ec53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:11.754605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cba8a7-7f86-4d5f-b86b-19bf7d62ec53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:11.756636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cba8a7-7f86-4d5f-b86b-19bf7d62ec53 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:11.771581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 17/37] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:11.774173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d0e-efbc-43f3-8994-c0a1ab4c1cd5 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.774904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d0e-efbc-43f3-8994-c0a1ab4c1cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.775393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d0e-efbc-43f3-8994-c0a1ab4c1cd5 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.777399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 18/38] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:11.778399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13707d0e-efbc-43f3-8994-c0a1ab4c1cd5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:11.793371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:11.800530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 21/39] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:11.801644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7d70-3e03-4639-9b91-4c95e08d1d56 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.802716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7d70-3e03-4639-9b91-4c95e08d1d56 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.802716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae7d70-3e03-4639-9b91-4c95e08d1d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.826265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-caae7d70-3e03-4639-9b91-4c95e08d1d56 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:11.827497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-caae7d70-3e03-4639-9b91-4c95e08d1d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:11.893561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 22/40] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:11.894377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7d70-3e03-4639-9b91-4c95e08d1d56 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:11.902669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13707d0e-efbc-43f3-8994-c0a1ab4c1cd5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:11.919690 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:11.938020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:11.938919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:11.939208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:11.939489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] PATH_INFO: `/v3/users/810ff4bb01dd49c79c0fe9e258d450e7` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:11.940788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] RBAC: Authorizing `identity:get_user(user_id=810ff4bb01dd49c79c0fe9e258d450e7)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:11.942255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:11.944152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 19/41] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:11 2022] GET /identity/v3/users/810ff4bb01dd49c79c0fe9e258d450e7 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:11.944918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:11.995206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae7d70-3e03-4639-9b91-4c95e08d1d56 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:12.022857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:12.028950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:12.029560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:12.029840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:12.030116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:12.030890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:12.032286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:12.045546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6747c8-5adb-4280-9f27-2cd0b093fb28 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:12.045705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 23/42] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 30 10:08:11 2022] POST /identity/v3/roles => generated 223 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:12.046274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:12.085410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:12.086229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:12.086518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:12.086864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:12.088755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:12.090254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:12.092174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 20/43] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:12.098114 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:12.156438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:12.168317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a185d-879a-41e6-8fa7-c1d3adcd2cce None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:12.208345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:12.209171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:12.209459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:12.209738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:12.211185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:12.212731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:12.218340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 24/44] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:12.221097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:12.291887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:12.333127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae036a29-faad-4497-aef2-8c6c029b78be None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:12.336401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f342b-b927-4898-9fe9-1c20b81fe06d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:12.367477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c4d49-d2f2-47b1-9d98-fbd8b7ab91af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:12.368131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c4d49-d2f2-47b1-9d98-fbd8b7ab91af None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:12.368415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c4d49-d2f2-47b1-9d98-fbd8b7ab91af None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:12.368691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c4d49-d2f2-47b1-9d98-fbd8b7ab91af None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:12.369440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c4d49-d2f2-47b1-9d98-fbd8b7ab91af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:12.369724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d00e5f-1e80-4e56-96f9-8c224a709da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:12.370585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00e5f-1e80-4e56-96f9-8c224a709da5 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:12.370899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00e5f-1e80-4e56-96f9-8c224a709da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:12.370985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c4d49-d2f2-47b1-9d98-fbd8b7ab91af None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:12.371184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00e5f-1e80-4e56-96f9-8c224a709da5 None admin] PATH_INFO: `/v3/domains/default/users/810ff4bb01dd49c79c0fe9e258d450e7/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:12.373496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d00e5f-1e80-4e56-96f9-8c224a709da5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=810ff4bb01dd49c79c0fe9e258d450e7, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:12.375017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d00e5f-1e80-4e56-96f9-8c224a709da5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:12.390061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 25/45] 10.222.0.44 () {58 vars in 1361 bytes} [Thu Jun 30 10:08:12 2022] PUT /identity/v3/domains/default/users/810ff4bb01dd49c79c0fe9e258d450e7/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:08:12.397074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 21/46] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:08:12 2022] POST /identity/v3/projects => generated 312 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:08:14.424216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a8196-2342-40eb-b80e-9e05b365273a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.424731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a8196-2342-40eb-b80e-9e05b365273a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.424813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a8196-2342-40eb-b80e-9e05b365273a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.426149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 26/47] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:14.431403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38100385-2e13-486c-8dfa-94ad66e61e80 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.432380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38100385-2e13-486c-8dfa-94ad66e61e80 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.432613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38100385-2e13-486c-8dfa-94ad66e61e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.449590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-38100385-2e13-486c-8dfa-94ad66e61e80 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:14.451163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-38100385-2e13-486c-8dfa-94ad66e61e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:14.452787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25eef7-6c18-4d41-b2b2-5cb14d1a59d8 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.453076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25eef7-6c18-4d41-b2b2-5cb14d1a59d8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.453349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25eef7-6c18-4d41-b2b2-5cb14d1a59d8 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.454787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 27/48] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:14.459313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa2a0-f47e-4718-a97f-7784b8ee5979 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.459607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa2a0-f47e-4718-a97f-7784b8ee5979 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.459893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa2a0-f47e-4718-a97f-7784b8ee5979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.475727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e44aa2a0-f47e-4718-a97f-7784b8ee5979 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:14.476909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e44aa2a0-f47e-4718-a97f-7784b8ee5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:14.518228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 22/49] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:14.541982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38100385-2e13-486c-8dfa-94ad66e61e80 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:14.544789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 28/50] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:14.567901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa2a0-f47e-4718-a97f-7784b8ee5979 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:14.575918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:14.616602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:14.644362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38100385-2e13-486c-8dfa-94ad66e61e80 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:14.667600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa2a0-f47e-4718-a97f-7784b8ee5979 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:14.678541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:14.679297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.679581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.679857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.689700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:14.697470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:14.698264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:14.699032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 23/51] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:14.702620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:14.703438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.703726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.704004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.704371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:14.705182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:14.706639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:14.708350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 29/52] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:14.714053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:14.800116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:14.807688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906eb00-deb4-4a9a-8b2d-d05f92fa8435 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:14.843752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:14.844439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.844725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.845009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.845777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:14.846092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:14.847548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:14.857350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 24/53] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:14.863039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:14.917559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad064ec-90a3-4431-b6fe-3ede9cdc209f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:14.933117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:14.952274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:14.952943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.953232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.953515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:14.954220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:14.955704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:14.960950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e8287-0a47-42f7-906d-f3f64a0fa3dd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:14.981826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 30/54] 10.222.0.44 () {60 vars in 1140 bytes} [Thu Jun 30 10:08:14 2022] POST /identity/v3/projects => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:08:14.997650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:14.998547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:14.998871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:14.999145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] PATH_INFO: `/v3/users/810ff4bb01dd49c79c0fe9e258d450e7` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:15.000436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] RBAC: Authorizing `identity:get_user(user_id=810ff4bb01dd49c79c0fe9e258d450e7)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:15.001955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:15.003709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 25/55] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:14 2022] GET /identity/v3/users/810ff4bb01dd49c79c0fe9e258d450e7 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:15.009527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:15.114054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1cfc-f659-40ec-b472-7510ba5cab7f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:15.148418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd548bf-1499-4783-b84b-01018fd7a677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:15.149215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd548bf-1499-4783-b84b-01018fd7a677 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:15.149504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd548bf-1499-4783-b84b-01018fd7a677 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:15.149783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd548bf-1499-4783-b84b-01018fd7a677 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:15.151027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd548bf-1499-4783-b84b-01018fd7a677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:15.152481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd548bf-1499-4783-b84b-01018fd7a677 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:15.154120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 31/56] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:15.160143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:15.190338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:15.268470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b773c-6247-4c87-98cc-ee322fa21897 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:15.300962 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5149fe-efd2-4d02-ae38-1c05e6639b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:15.301613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5149fe-efd2-4d02-ae38-1c05e6639b05 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:15.301901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5149fe-efd2-4d02-ae38-1c05e6639b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:15.302177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5149fe-efd2-4d02-ae38-1c05e6639b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:15.303039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5149fe-efd2-4d02-ae38-1c05e6639b05 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.domain.id=default, user.id=810ff4bb01dd49c79c0fe9e258d450e7) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:15.303353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5149fe-efd2-4d02-ae38-1c05e6639b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:15.304816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5149fe-efd2-4d02-ae38-1c05e6639b05 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:15.311373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 26/57] 10.222.0.44 () {56 vars in 1322 bytes} [Thu Jun 30 10:08:15 2022] GET /identity/v3/role_assignments?user.id=810ff4bb01dd49c79c0fe9e258d450e7&scope.domain.id=default&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:17.019284 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8987-f79c-469c-a013-a2976047035c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:17.019794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8987-f79c-469c-a013-a2976047035c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:17.019875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be8987-f79c-469c-a013-a2976047035c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:17.021228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 32/58] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:17.026769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3974a-7d65-4d0c-ba6d-e6c1d55567eb None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:17.027127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3974a-7d65-4d0c-ba6d-e6c1d55567eb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:17.027330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3974a-7d65-4d0c-ba6d-e6c1d55567eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:17.044800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-dba3974a-7d65-4d0c-ba6d-e6c1d55567eb None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:17.046000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dba3974a-7d65-4d0c-ba6d-e6c1d55567eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:17.110515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 27/59] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:17.134257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8987-f79c-469c-a013-a2976047035c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:17.169755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:17.233243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be8987-f79c-469c-a013-a2976047035c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:17.265352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdae85e-ae83-4b9c-ba38-4e83c2298ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:17.266125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae85e-ae83-4b9c-ba38-4e83c2298ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:17.266415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae85e-ae83-4b9c-ba38-4e83c2298ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:17.266716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdae85e-ae83-4b9c-ba38-4e83c2298ad8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:17.267893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdae85e-ae83-4b9c-ba38-4e83c2298ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:17.269378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdae85e-ae83-4b9c-ba38-4e83c2298ad8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:17.270960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 33/60] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:17.277025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3974a-7d65-4d0c-ba6d-e6c1d55567eb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:17.294852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:17.373773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3974a-7d65-4d0c-ba6d-e6c1d55567eb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:17.407216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5601e-683a-4925-8bb8-9808e8cb3515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:17.407887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5601e-683a-4925-8bb8-9808e8cb3515 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:17.408177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5601e-683a-4925-8bb8-9808e8cb3515 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:17.408459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5601e-683a-4925-8bb8-9808e8cb3515 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:17.409167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5601e-683a-4925-8bb8-9808e8cb3515 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:17.410640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5601e-683a-4925-8bb8-9808e8cb3515 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:17.434494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 28/61] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:08:17 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:20.586090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946e6c-207c-459b-952e-d5ea9fd822d7 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:20.587128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946e6c-207c-459b-952e-d5ea9fd822d7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:20.587615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946e6c-207c-459b-952e-d5ea9fd822d7 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:20.589871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 34/62] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:20.595481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159bc70-6788-45fc-81bf-ee347aead29b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:20.596310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159bc70-6788-45fc-81bf-ee347aead29b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:20.596824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159bc70-6788-45fc-81bf-ee347aead29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:20.614170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a159bc70-6788-45fc-81bf-ee347aead29b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:20.615716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a159bc70-6788-45fc-81bf-ee347aead29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:20.687635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 29/63] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:20.703513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c479b7b-9fd0-422b-84f2-c0b7d72535cf None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:20.703816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c479b7b-9fd0-422b-84f2-c0b7d72535cf None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:20.704105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c479b7b-9fd0-422b-84f2-c0b7d72535cf None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:20.705769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 35/64] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:20.710558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572b193-0aa8-48d9-b205-c0ac9a3c672e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:20.710919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572b193-0aa8-48d9-b205-c0ac9a3c672e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:20.711207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572b193-0aa8-48d9-b205-c0ac9a3c672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:20.717373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:20.726418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c479b7b-9fd0-422b-84f2-c0b7d72535cf None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:20.730014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-e572b193-0aa8-48d9-b205-c0ac9a3c672e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:20.731251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e572b193-0aa8-48d9-b205-c0ac9a3c672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:20.832452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 30/65] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:20.840134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce888-6839-45ae-9329-9862a4241bf7 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:20.840583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce888-6839-45ae-9329-9862a4241bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:20.841011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce888-6839-45ae-9329-9862a4241bf7 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:20.842463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 31/66] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:20.860102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42681d2-7464-4bec-8646-1023309d0ed8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:20.860682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42681d2-7464-4bec-8646-1023309d0ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:20.861141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42681d2-7464-4bec-8646-1023309d0ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:20.874549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c479b7b-9fd0-422b-84f2-c0b7d72535cf None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:20.877776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:20.883113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a42681d2-7464-4bec-8646-1023309d0ed8 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:20.884990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a42681d2-7464-4bec-8646-1023309d0ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:20.917813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:20.918721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:20.919283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:20.919642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:20.933425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:20.943208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:20.944158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:20.945175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:20.947484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 36/67] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:20.949435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:20.959491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 32/68] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:20.961159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42681d2-7464-4bec-8646-1023309d0ed8 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.029055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.071425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42681d2-7464-4bec-8646-1023309d0ed8 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.079374 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d7e21-5fe6-4d47-b798-af1bbef77da2 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.109876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.110487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.110817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.111096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.111857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:21.112180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.113605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.116290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86672659-d591-4609-af32-ff660d10cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.117333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672659-d591-4609-af32-ff660d10cf73 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.117815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672659-d591-4609-af32-ff660d10cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.118294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672659-d591-4609-af32-ff660d10cf73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.122967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 33/69] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:21.123867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.132225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672659-d591-4609-af32-ff660d10cf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-86672659-d591-4609-af32-ff660d10cf73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:21.140034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:21.140881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:21.141645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 37/70] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:21.142871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b3d1-4f1c-4504-b4dd-0c0c5154bd69 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.142871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b3d1-4f1c-4504-b4dd-0c0c5154bd69 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.143037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731b3d1-4f1c-4504-b4dd-0c0c5154bd69 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.144457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 38/71] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:21.145000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b3d1-4f1c-4504-b4dd-0c0c5154bd69 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.181553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.239220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee9f4c-1983-4d4f-929b-58dbbc527ccb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.264274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.266362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731b3d1-4f1c-4504-b4dd-0c0c5154bd69 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.273718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.274524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.274845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.275133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.285583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:21.294225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:21.295103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 34/72] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:21.300990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.303958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f4ac2-5e3a-4b7a-ad7b-5824fee19ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.304914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f4ac2-5e3a-4b7a-ad7b-5824fee19ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.305203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f4ac2-5e3a-4b7a-ad7b-5824fee19ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.305480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f4ac2-5e3a-4b7a-ad7b-5824fee19ac3 None admin] PATH_INFO: `/v3/users/810ff4bb01dd49c79c0fe9e258d450e7` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.306707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f4ac2-5e3a-4b7a-ad7b-5824fee19ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=810ff4bb01dd49c79c0fe9e258d450e7)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.308780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f4ac2-5e3a-4b7a-ad7b-5824fee19ac3 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.310412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 39/73] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/users/810ff4bb01dd49c79c0fe9e258d450e7 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:21.311892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05114e22-08b7-450f-93c1-bfc5f86200ba None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.312184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05114e22-08b7-450f-93c1-bfc5f86200ba None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.312463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05114e22-08b7-450f-93c1-bfc5f86200ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.328680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-05114e22-08b7-450f-93c1-bfc5f86200ba None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:21.329877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-05114e22-08b7-450f-93c1-bfc5f86200ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:21.395167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 40/74] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:21.396554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea684a-815c-4135-8149-856ac891c078 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.396852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea684a-815c-4135-8149-856ac891c078 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.397136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea684a-815c-4135-8149-856ac891c078 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.398415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 41/75] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:21.402171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea684a-815c-4135-8149-856ac891c078 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.408031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6674ce-f612-4161-8b30-2c1c46e12a13 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.426119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.445202 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.445877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.446167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.446447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.447230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:21.447573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.448985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.456968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 35/76] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:21.457762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.506163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea684a-815c-4135-8149-856ac891c078 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.508340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.539456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0f83c-448f-4c00-adbf-c9f26403fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.540120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0f83c-448f-4c00-adbf-c9f26403fec9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.540404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0f83c-448f-4c00-adbf-c9f26403fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.540681 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0f83c-448f-4c00-adbf-c9f26403fec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.542024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0f83c-448f-4c00-adbf-c9f26403fec9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:21.542330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0f83c-448f-4c00-adbf-c9f26403fec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.543731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0f83c-448f-4c00-adbf-c9f26403fec9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.554663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 42/77] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:21.554663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec09e-9aa3-4dcd-b140-a5af9b4dd0c5 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.554663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec09e-9aa3-4dcd-b140-a5af9b4dd0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.554663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ec09e-9aa3-4dcd-b140-a5af9b4dd0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.565922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4b08a-adfe-4593-a977-faa929fe4221 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.572516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-600ec09e-9aa3-4dcd-b140-a5af9b4dd0c5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:21.573691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-600ec09e-9aa3-4dcd-b140-a5af9b4dd0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:21.599602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.600261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.600556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.600843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.639502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 43/78] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:21.640319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ec09e-9aa3-4dcd-b140-a5af9b4dd0c5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.655367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.677947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.679485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.727948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.739384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ec09e-9aa3-4dcd-b140-a5af9b4dd0c5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.772471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.773535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.773826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.775019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.777140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.778939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 44/79] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:21.779613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.780824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 36/80] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:21.781559 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.864015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.878700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6626c-551f-41e8-88b5-2bb05db86f0c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.881889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec15c5b-0832-4e65-a114-fedeb9fbac49 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:21.912320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.913110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.913390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.913665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.916040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:21.916926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:21.917214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:21.917497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:21.927440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.928909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.930561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 37/81] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:21.931350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:21.936596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:21.938043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:21.939463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:21.939990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 45/82] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:21.940664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.029012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741dc3-7f06-4d54-9e4f-30eebae3e16e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.044566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0328d9-fea6-47f3-a75f-b18f36dc8227 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.061871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.062665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.062977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.063259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.074008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:22.078502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.079193 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.079481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.079766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.080482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:22.081642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:22.082613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:22.083433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:22.084009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:22.084074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 38/83] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:22.084074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.100110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.111610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 46/84] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:08:21 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:22.112620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.158629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.202395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841e2b8-07de-4abe-a87c-7d53d77b929f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.240072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.240946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.241048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9f9f-c9ba-4def-9e86-6817c33999db None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.241228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.241503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.242761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:22.244801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:22.246586 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 39/85] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:22.252325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.286840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.288232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.288232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.288506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.366083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.374730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:22.375163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33750cf-6f96-436e-a8df-d95fed5c9e37 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.375482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:22.423884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.424933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.425229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.425518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.429513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.500014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 47/86] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:22.501268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.527951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:22.529776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:22.632922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.641442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98170a4f-a906-4c96-90de-c024d3e8c6f4 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.642022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 40/87] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:22.642910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.679754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.680769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.681258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.681736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.682875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:22.683415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:22.684886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.685265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:22.694914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 48/88] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:22.696670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.763716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a742-9cf6-4751-93ef-1aa4566a0992 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.802581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.803294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.803584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.803852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.804700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=810ff4bb01dd49c79c0fe9e258d450e7) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:22.805278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:22.806519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:22.812677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 41/89] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/role_assignments?user.id=810ff4bb01dd49c79c0fe9e258d450e7&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:22.813505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.830286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40110875-5caa-4ce6-bb8e-9e46e617761b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:22.879793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:22.880665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:22.880955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:22.881237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:22.883994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:22.886064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:22.887946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 49/90] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:22.888722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:22.919134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.946746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:22.955835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6e0fd-6d9f-4da1-a5e3-b3dcbdba7992 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:23.013078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:23.014338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:23.014812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:23.015238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:23.019412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:23.021140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:23.027169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 42/91] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:23.028178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:23.060796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321745a-3322-4729-b86a-20a106cc8914 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:23.117039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:23.117673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:23.117958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:23.118239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:23.123483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:23.125081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:23.127029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 50/92] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:22 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:23.127399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:23.150149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd4ab8-c1cc-4090-8dbc-1e03913b534c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:23.187816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:23.188697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:23.189133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:23.189561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:23.190541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] RBAC: Adding query filter params (role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=f4d8dca6da814ed3aee97c9b23323a72) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:23.191051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:23.192755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:23.199561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 43/93] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:23 2022] GET /identity/v3/role_assignments?user.id=f4d8dca6da814ed3aee97c9b23323a72&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:23.200534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:23.236101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:23.282727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:23.290533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760786fb-d40d-4c29-a54c-7d48b8ac3b39 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:23.318497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecc071-5a6b-4c8a-857c-5c52efe9a536 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:23.328868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:23.329549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:23.329836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:23.330434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:23.331025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=f4d8dca6da814ed3aee97c9b23323a72) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:23.331349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:23.332832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:23.342003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 51/94] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:23 2022] GET /identity/v3/role_assignments?user.id=f4d8dca6da814ed3aee97c9b23323a72&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=9987e14f9f4744858d584c8867b2a56c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:23.361324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:23.362277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:23.362800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:23.363272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:23.450227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:23.452017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:23.494731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:23.565914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 44/95] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:23.573128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:23.699749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801fe30-2e2d-4f69-a48b-a7336572b665 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:23.747500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35ba10-0e18-4b20-aa26-5b873a9f5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:23.748373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ba10-0e18-4b20-aa26-5b873a9f5c79 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:23.748709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ba10-0e18-4b20-aa26-5b873a9f5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:23.748999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ba10-0e18-4b20-aa26-5b873a9f5c79 None admin] PATH_INFO: `/v3/projects/67caeffa19ef4c04835570c2bf4bf553` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:23.750207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35ba10-0e18-4b20-aa26-5b873a9f5c79 None admin] RBAC: Authorizing `identity:get_project(project_id=67caeffa19ef4c04835570c2bf4bf553)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:23.751701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35ba10-0e18-4b20-aa26-5b873a9f5c79 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:23.753611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 52/96] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:23 2022] GET /identity/v3/projects/67caeffa19ef4c04835570c2bf4bf553 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:23.759388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:23.864503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14127d0-d46e-47ba-926c-a35755b1f004 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:23.895058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:23.901064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0a9f3-cf34-47e2-9436-2c93bc98c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:23.901807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a9f3-cf34-47e2-9436-2c93bc98c54b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:23.902536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a9f3-cf34-47e2-9436-2c93bc98c54b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:23.902864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0a9f3-cf34-47e2-9436-2c93bc98c54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:23.903768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0a9f3-cf34-47e2-9436-2c93bc98c54b None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=67caeffa19ef4c04835570c2bf4bf553, user.id=f4d8dca6da814ed3aee97c9b23323a72) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:23.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0a9f3-cf34-47e2-9436-2c93bc98c54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:23.906287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0a9f3-cf34-47e2-9436-2c93bc98c54b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:23.912619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 45/97] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:23 2022] GET /identity/v3/role_assignments?user.id=f4d8dca6da814ed3aee97c9b23323a72&scope.project.id=67caeffa19ef4c04835570c2bf4bf553&role.id=9987e14f9f4744858d584c8867b2a56c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:24.880240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c20a72-2c9c-444a-8cbf-12a35cd68b32 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:24.881234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c20a72-2c9c-444a-8cbf-12a35cd68b32 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:24.881729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c20a72-2c9c-444a-8cbf-12a35cd68b32 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:24.883368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 53/98] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:24.889457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a8b0d-c085-4c9f-841c-142ea56be99e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:24.890304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a8b0d-c085-4c9f-841c-142ea56be99e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:24.890815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a8b0d-c085-4c9f-841c-142ea56be99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:24.908868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ef3a8b0d-c085-4c9f-841c-142ea56be99e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:24.910363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ef3a8b0d-c085-4c9f-841c-142ea56be99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:24.981793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 46/99] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:25.016324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c20a72-2c9c-444a-8cbf-12a35cd68b32 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:25.046979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:25.144033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c20a72-2c9c-444a-8cbf-12a35cd68b32 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:25.187570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb40a3f-156c-4f79-88e0-c4426f0bb3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:25.188458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40a3f-156c-4f79-88e0-c4426f0bb3cd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:25.188752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40a3f-156c-4f79-88e0-c4426f0bb3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:25.189034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40a3f-156c-4f79-88e0-c4426f0bb3cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:25.190437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb40a3f-156c-4f79-88e0-c4426f0bb3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:25.192184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb40a3f-156c-4f79-88e0-c4426f0bb3cd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:25.194292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 54/100] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:25.200761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a8b0d-c085-4c9f-841c-142ea56be99e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:25.326059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a8b0d-c085-4c9f-841c-142ea56be99e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:25.355180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:25.362907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2067b-c93e-4e7e-bc22-c7ee7d276e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:25.363590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2067b-c93e-4e7e-bc22-c7ee7d276e65 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:25.363881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2067b-c93e-4e7e-bc22-c7ee7d276e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:25.364212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2067b-c93e-4e7e-bc22-c7ee7d276e65 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:25.364938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2067b-c93e-4e7e-bc22-c7ee7d276e65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:25.366425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2067b-c93e-4e7e-bc22-c7ee7d276e65 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:25.403618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 47/101] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:08:25 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:25.567357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44096ee-87db-4896-a93c-bd6b35e32e7d None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:25.568044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44096ee-87db-4896-a93c-bd6b35e32e7d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:25.568522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44096ee-87db-4896-a93c-bd6b35e32e7d None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:25.570434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 55/102] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:25.577124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ab92-6c4c-499d-83e7-9517fc79fd79 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:25.577432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ab92-6c4c-499d-83e7-9517fc79fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:25.577722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ab92-6c4c-499d-83e7-9517fc79fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:25.599696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ecc5ab92-6c4c-499d-83e7-9517fc79fd79 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:25.600993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ecc5ab92-6c4c-499d-83e7-9517fc79fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:25.686999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 48/103] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:25.733690 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44096ee-87db-4896-a93c-bd6b35e32e7d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:25.862966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:25.872211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44096ee-87db-4896-a93c-bd6b35e32e7d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:25.875882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420916b-0370-429d-9dc3-67308509dcd1 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:25.876485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420916b-0370-429d-9dc3-67308509dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:25.876957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420916b-0370-429d-9dc3-67308509dcd1 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:25.879519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 49/104] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:25.886416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eec64-d14f-4681-91b5-697e4b33540e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:25.887017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eec64-d14f-4681-91b5-697e4b33540e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:25.887490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eec64-d14f-4681-91b5-697e4b33540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:25.912239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-833eec64-d14f-4681-91b5-697e4b33540e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:25.913448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-833eec64-d14f-4681-91b5-697e4b33540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:25.931004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:25.932327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:25.932636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:25.932916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:25.955594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:25.967769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:25.968620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:25.969350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:25.977397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 56/105] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:25.981972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:26.055063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 50/106] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:26.095353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eec64-d14f-4681-91b5-697e4b33540e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:26.183221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:26.199050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa073f-25b5-4743-8fa3-1dcaa0959eb3 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:26.278815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:26.279398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.279691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.279981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.280751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:26.281067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:26.282483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:26.297389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 57/107] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:26.304200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:26.344538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:26.376392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eec64-d14f-4681-91b5-697e4b33540e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:26.454995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4e1cf-96c2-4a6a-a651-4845e96ab2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:26.455811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4e1cf-96c2-4a6a-a651-4845e96ab2ea None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.456101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4e1cf-96c2-4a6a-a651-4845e96ab2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.456386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4e1cf-96c2-4a6a-a651-4845e96ab2ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.492231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4e1cf-96c2-4a6a-a651-4845e96ab2ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-84e4e1cf-96c2-4a6a-a651-4845e96ab2ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:26.506449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:26.507370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:26.508113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 51/108] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:26.509446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89200-d8e6-47af-8247-dc85c06dd5f0 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.509446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89200-d8e6-47af-8247-dc85c06dd5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.512589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c89200-d8e6-47af-8247-dc85c06dd5f0 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.513898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 52/109] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:26.519517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89200-d8e6-47af-8247-dc85c06dd5f0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:26.553131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54209ac3-5d26-4807-9dc9-5a19e3bb4c7c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:26.602956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe93692-10ae-4648-aed1-360afdc98f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:26.603942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93692-10ae-4648-aed1-360afdc98f7d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.604233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93692-10ae-4648-aed1-360afdc98f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.604517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93692-10ae-4648-aed1-360afdc98f7d None admin] PATH_INFO: `/v3/users/1b16bcef608a4807a7d4d73dd3f7b284` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.622384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe93692-10ae-4648-aed1-360afdc98f7d None admin] RBAC: Authorizing `identity:get_user(user_id=1b16bcef608a4807a7d4d73dd3f7b284)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:26.624331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe93692-10ae-4648-aed1-360afdc98f7d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:26.626599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 58/110] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:26 2022] GET /identity/v3/users/1b16bcef608a4807a7d4d73dd3f7b284 => generated 289 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:26.631759 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d423b-9ce5-4953-b825-be2f858a1c67 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.632047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d423b-9ce5-4953-b825-be2f858a1c67 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.632324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d423b-9ce5-4953-b825-be2f858a1c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.648635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:26.651180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-026d423b-9ce5-4953-b825-be2f858a1c67 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:26.652478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-026d423b-9ce5-4953-b825-be2f858a1c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:26.656648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c89200-d8e6-47af-8247-dc85c06dd5f0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:26.692000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08528ee3-12e7-4290-9c13-b9a987ff708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:26.692692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08528ee3-12e7-4290-9c13-b9a987ff708b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.692956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08528ee3-12e7-4290-9c13-b9a987ff708b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.693232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08528ee3-12e7-4290-9c13-b9a987ff708b None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.693981 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08528ee3-12e7-4290-9c13-b9a987ff708b None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:26.694289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08528ee3-12e7-4290-9c13-b9a987ff708b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:26.696001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08528ee3-12e7-4290-9c13-b9a987ff708b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:26.705877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 53/111] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:26.707016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1d80-fa85-45c5-8d40-da759d0d6341 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.707312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1d80-fa85-45c5-8d40-da759d0d6341 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.707593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1d80-fa85-45c5-8d40-da759d0d6341 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.713436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 54/112] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:26.713436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1d80-fa85-45c5-8d40-da759d0d6341 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:26.737008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 59/113] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:26.738124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dde52-bf7e-4146-bde9-06f578fbe5e5 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.738418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dde52-bf7e-4146-bde9-06f578fbe5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.738708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dde52-bf7e-4146-bde9-06f578fbe5e5 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.740242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 60/114] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:26.740766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dde52-bf7e-4146-bde9-06f578fbe5e5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:26.745464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:26.846150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1d80-fa85-45c5-8d40-da759d0d6341 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:26.852449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dde52-bf7e-4146-bde9-06f578fbe5e5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:26.882852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:26.883496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.883784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.884059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.888011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b735f-6821-4135-bdbd-f611a1602ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:26.888877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b735f-6821-4135-bdbd-f611a1602ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.889166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b735f-6821-4135-bdbd-f611a1602ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.889502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b735f-6821-4135-bdbd-f611a1602ce7 None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.890703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b735f-6821-4135-bdbd-f611a1602ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:26.892194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b735f-6821-4135-bdbd-f611a1602ce7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:26.898439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 61/115] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:26 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:26.898439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b1c39-9cb0-45bc-8b54-46e06504cdae None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.898439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b1c39-9cb0-45bc-8b54-46e06504cdae None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.898439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b1c39-9cb0-45bc-8b54-46e06504cdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:26.911547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6d4b1c39-9cb0-45bc-8b54-46e06504cdae None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:26.912724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6d4b1c39-9cb0-45bc-8b54-46e06504cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:26.916479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:26.959623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:26.961090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:26.986284 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 62/116] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:26.992920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea04c-5053-47c2-b433-550621bb4eb6 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:26.993362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea04c-5053-47c2-b433-550621bb4eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:26.993858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea04c-5053-47c2-b433-550621bb4eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.000822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.018079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f86ea04c-5053-47c2-b433-550621bb4eb6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:27.019320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f86ea04c-5053-47c2-b433-550621bb4eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:27.074165 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 55/117] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:27.075053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.090735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 63/118] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:27.091886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ea04c-5053-47c2-b433-550621bb4eb6 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.147426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.192162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a38b9-292e-43d1-ad91-248d51b252d9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.202854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ea04c-5053-47c2-b433-550621bb4eb6 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.229656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.230456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.230783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.231068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.236232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.241622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:27.242102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.242988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.243271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.243544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.245307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:27.246785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:27.253504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 64/119] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:27.253504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:27.253702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:27.254491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 56/120] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:27.255291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.359152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a971f3-82aa-4dbe-b767-2c71992ced6b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.374005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5f834-8325-4959-9edb-0a5ce2e3d8d2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.391668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.394053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.395345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.395609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.395892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.407502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:27.409656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.410512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.410836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.411121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.412315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:27.413787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:27.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:27.415897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:27.417230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:27.417790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 57/121] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:27.417790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.417913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 65/122] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:27.417913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.495583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.534289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d882c6-3eeb-4d98-b980-43be96ecd47f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.542266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d91c-471e-418c-bc61-95a2f3a0d67c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.573853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.574699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.574998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.575276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.580072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.581154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.581611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.582057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/f4d8dca6da814ed3aee97c9b23323a72/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.584248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] RBAC: Authorizing `identity:create_grant(project_id=6f127d6bcfe64a2694256fed07561a95, user_id=f4d8dca6da814ed3aee97c9b23323a72, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:27.585856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:27.586006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:27.594232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:27.595172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:27.596041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 58/123] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:27.596659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.606711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 66/124] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:27 2022] PUT /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/f4d8dca6da814ed3aee97c9b23323a72/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:27.607420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.671053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.744145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae61f5-ab76-4f07-a095-46e78322b4fa None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.747042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d211f-ca28-400a-8990-cd58a130602f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.767946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.788088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.788781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.789070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.789360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.789631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.790120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:27.790291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.790444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:27.790592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.790881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.792255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] RBAC: Adding query filter params (role.id=7af225d2412e4fb7bbc4156f193b37d0, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=1b16bcef608a4807a7d4d73dd3f7b284) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:27.792411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:27.792570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:27.794211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:27.801691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 67/125] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/role_assignments?user.id=1b16bcef608a4807a7d4d73dd3f7b284&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=7af225d2412e4fb7bbc4156f193b37d0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:27.801691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.802055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 59/126] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:27.805894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:27.923299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb2351-9503-42d5-9d2c-692c63947183 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.944184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee23e2d-a10a-413d-b027-488206238e7b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:27.966714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:27.975481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:27.976162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:27.976446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:27.976724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:27.977490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:27.977798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:27.983651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.000436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 68/127] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.001349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.021574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.022262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.022547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.022859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.023622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:28.023930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.026398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.038194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 60/128] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.043315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.064059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:28.156557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ddb29-11af-4ab0-9969-a33b24c1baaa None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.176694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189827b7-5b27-4433-8e0d-e713d3fb3fbb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.199603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.200895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.201417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.201911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.203403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.205077 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.207046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 69/129] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:28 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.208079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.225437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fee2a5-61ff-4966-818f-dbd0995baaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.226312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fee2a5-61ff-4966-818f-dbd0995baaea None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.226600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fee2a5-61ff-4966-818f-dbd0995baaea None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.226912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fee2a5-61ff-4966-818f-dbd0995baaea None admin] PATH_INFO: `/v3/users/810ff4bb01dd49c79c0fe9e258d450e7` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.228397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fee2a5-61ff-4966-818f-dbd0995baaea None admin] RBAC: Authorizing `identity:get_user(user_id=810ff4bb01dd49c79c0fe9e258d450e7)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.231191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fee2a5-61ff-4966-818f-dbd0995baaea None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.233289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 61/130] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:28 2022] GET /identity/v3/users/810ff4bb01dd49c79c0fe9e258d450e7 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.234722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3688d-f863-4d14-a070-5b5018b755c7 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.235014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3688d-f863-4d14-a070-5b5018b755c7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.235289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3688d-f863-4d14-a070-5b5018b755c7 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.236537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 62/131] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:28.240689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3688d-f863-4d14-a070-5b5018b755c7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.285878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:28.350805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891d7b7-46ee-4bb4-bb73-4dc83ecbf37d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.364471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3688d-f863-4d14-a070-5b5018b755c7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.369063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:28.394742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.396121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.396610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.397086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.398621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.400317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.402402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 70/132] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:28 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.403797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.405335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367abf41-8497-4c50-8743-a5b834251700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.406264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367abf41-8497-4c50-8743-a5b834251700 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.406567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367abf41-8497-4c50-8743-a5b834251700 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.406871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367abf41-8497-4c50-8743-a5b834251700 None admin] PATH_INFO: `/v3/projects/67caeffa19ef4c04835570c2bf4bf553` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.408238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367abf41-8497-4c50-8743-a5b834251700 None admin] RBAC: Authorizing `identity:get_project(project_id=67caeffa19ef4c04835570c2bf4bf553)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.409948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367abf41-8497-4c50-8743-a5b834251700 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.412006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 63/133] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:28 2022] GET /identity/v3/projects/67caeffa19ef4c04835570c2bf4bf553 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.413182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356418b5-ceb7-4e37-bd53-d967a43c17c2 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.413476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356418b5-ceb7-4e37-bd53-d967a43c17c2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.413762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356418b5-ceb7-4e37-bd53-d967a43c17c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.431748 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-356418b5-ceb7-4e37-bd53-d967a43c17c2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:28.433558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-356418b5-ceb7-4e37-bd53-d967a43c17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:28.522709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 64/134] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:28.522709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356418b5-ceb7-4e37-bd53-d967a43c17c2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.527123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b61b8-83db-462b-9889-edb475ce2d34 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.558745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:28.583992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.584874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.585682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.585984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.587535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.589291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.592239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 71/135] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:28 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.594838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.644875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356418b5-ceb7-4e37-bd53-d967a43c17c2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.646395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:28.686113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.686936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.687269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.687557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.688774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.690353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.692100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 65/136] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:28 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.692989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.702964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e9f3-21d5-4933-b736-708d9c2d3b74 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.737974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.739220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.739732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.740220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] PATH_INFO: `/v3/projects/67caeffa19ef4c04835570c2bf4bf553/users/f4d8dca6da814ed3aee97c9b23323a72/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.742434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=67caeffa19ef4c04835570c2bf4bf553, user_id=f4d8dca6da814ed3aee97c9b23323a72, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.744120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.759506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 72/137] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:28 2022] PUT /identity/v3/projects/67caeffa19ef4c04835570c2bf4bf553/users/f4d8dca6da814ed3aee97c9b23323a72/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:28.760899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.811296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4deddd-a93a-4045-9146-c44d49e52217 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.813982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:28.854503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.855471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.855764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.856046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.857297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.858914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.865326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 66/138] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:28.865326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:28.881799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b76d15-50e7-435c-b6e7-1e8aa65613c7 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.895201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:28.946503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:28.947813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:28.948325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:28.948822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/810ff4bb01dd49c79c0fe9e258d450e7/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:28.955166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f127d6bcfe64a2694256fed07561a95, user_id=810ff4bb01dd49c79c0fe9e258d450e7, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:28.957001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:28.994909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2891f9-4e90-4624-ac26-c3ece587d3d1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:28.995666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 73/139] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:28 2022] PUT /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/810ff4bb01dd49c79c0fe9e258d450e7/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:28.996616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:29.090172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764a501-f86d-4c67-930f-4a148b3a4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:29.091101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764a501-f86d-4c67-930f-4a148b3a4931 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:29.091388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764a501-f86d-4c67-930f-4a148b3a4931 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:29.091902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764a501-f86d-4c67-930f-4a148b3a4931 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/f4d8dca6da814ed3aee97c9b23323a72/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:29.102239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764a501-f86d-4c67-930f-4a148b3a4931 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f127d6bcfe64a2694256fed07561a95, user_id=f4d8dca6da814ed3aee97c9b23323a72, role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:29.105188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764a501-f86d-4c67-930f-4a148b3a4931 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:29.132922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 67/140] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:28 2022] PUT /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/f4d8dca6da814ed3aee97c9b23323a72/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:29.192062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020d526-f49b-4b79-98e3-31a2d68371c5 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:29.239506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff905b-d6b3-4327-bc37-1e8a89602527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:29.239938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff905b-d6b3-4327-bc37-1e8a89602527 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:29.240216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff905b-d6b3-4327-bc37-1e8a89602527 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:29.240544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff905b-d6b3-4327-bc37-1e8a89602527 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:29.241347 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff905b-d6b3-4327-bc37-1e8a89602527 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:29.242949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff905b-d6b3-4327-bc37-1e8a89602527 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:29.269317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 74/141] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:08:28 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:30.049074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e84a2-2348-44ce-9b0e-7914ac074ffd None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:30.049581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e84a2-2348-44ce-9b0e-7914ac074ffd None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:30.049695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e84a2-2348-44ce-9b0e-7914ac074ffd None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:30.051280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 68/142] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:30.057342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77657-2a8a-41d1-ab58-97007b8da3e7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:30.057642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77657-2a8a-41d1-ab58-97007b8da3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:30.057928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77657-2a8a-41d1-ab58-97007b8da3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:30.076200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-cbf77657-2a8a-41d1-ab58-97007b8da3e7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:30.077409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cbf77657-2a8a-41d1-ab58-97007b8da3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:30.100722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:30.155621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 75/143] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:30.179003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e84a2-2348-44ce-9b0e-7914ac074ffd None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:30.215928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:30.308848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e84a2-2348-44ce-9b0e-7914ac074ffd None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:30.346780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:30.347587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:30.347870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:30.348146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:30.359436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:30.367246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:30.368908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:30.369927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:30.370702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b78cc-bf16-4175-b9d0-887c1e67eb83 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:30.370702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b78cc-bf16-4175-b9d0-887c1e67eb83 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:30.370702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b78cc-bf16-4175-b9d0-887c1e67eb83 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:30.371814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 76/144] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:30.372264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 69/145] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:30.377670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9e42-8116-404a-a999-5ac399c749e3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:30.377898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:30.378130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9e42-8116-404a-a999-5ac399c749e3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:30.378353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9e42-8116-404a-a999-5ac399c749e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:30.406252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9e7c9e42-8116-404a-a999-5ac399c749e3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:30.407918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9e7c9e42-8116-404a-a999-5ac399c749e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:30.497400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 77/146] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:30.555742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:30.570338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9ef1f-96e1-4a68-8d7a-e2aa4334c263 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:30.616048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c9e42-8116-404a-a999-5ac399c749e3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:30.627548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:30.628240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:30.628522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:30.628799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:30.629573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:30.629883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:30.635942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:30.656477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 70/147] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:30.662566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:30.779567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:30.799820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c9e42-8116-404a-a999-5ac399c749e3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:30.844391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:30.845132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:30.845420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:30.845701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:30.859511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:30.867699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:30.868590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:30.869340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:30.869959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 78/148] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:30.876354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:30.952684 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d6b2b-35e6-466b-bef1-5acc077d4032 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:31.012151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f854-74b2-43cc-b98c-8a52c73ccce9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:31.058435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:31.059201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:31.059488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:31.059766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:31.060564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:31.060879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:31.065409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:31.075556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 79/149] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:31.077688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:31.078584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:31.078900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:31.079187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] PATH_INFO: `/v3/users/1b16bcef608a4807a7d4d73dd3f7b284` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:31.083794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] RBAC: Authorizing `identity:get_user(user_id=1b16bcef608a4807a7d4d73dd3f7b284)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:31.084014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:31.085405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:31.087144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 71/150] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:30 2022] GET /identity/v3/users/1b16bcef608a4807a7d4d73dd3f7b284 => generated 289 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:31.093272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:31.099117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:31.143263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:31.224679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31d83c-3ade-427d-ba75-84e06f52b12a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:31.269325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c5f5c-8610-4ef0-a6ed-77af1bbec9b2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:31.285668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:31.286908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:31.287384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:31.287880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:31.290057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:31.291788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:31.295750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 80/151] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:31 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:31.301754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:31.342144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:31.343401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:31.343889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:31.344371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:31.346805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:31.348498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:31.350632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 72/152] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:31 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:31.367098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:31.475046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:31.526995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd70483-3db6-4269-8b64-b2abe9db3256 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:31.593558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988590ad-88cb-4231-9efe-116bc434d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:31.594560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988590ad-88cb-4231-9efe-116bc434d69b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:31.595098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988590ad-88cb-4231-9efe-116bc434d69b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:31.595865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988590ad-88cb-4231-9efe-116bc434d69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:31.606030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:31.628681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6aaa2-acc0-4b3f-82fd-4c366fc215c5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:31.678163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:31.679136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:31.679424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:31.679876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/1b16bcef608a4807a7d4d73dd3f7b284/roles/7af225d2412e4fb7bbc4156f193b37d0` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:31.681921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f127d6bcfe64a2694256fed07561a95, user_id=1b16bcef608a4807a7d4d73dd3f7b284, role_id=7af225d2412e4fb7bbc4156f193b37d0)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:31.683964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:31.712973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 73/153] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:31 2022] PUT /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95/users/1b16bcef608a4807a7d4d73dd3f7b284/roles/7af225d2412e4fb7bbc4156f193b37d0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:31.751812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988590ad-88cb-4231-9efe-116bc434d69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:31.753645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988590ad-88cb-4231-9efe-116bc434d69b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:31.871000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:31.895781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 81/154] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:31.902256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:32.033844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5058a-ae85-4056-9ce1-e3128e0e82a6 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:32.034473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5058a-ae85-4056-9ce1-e3128e0e82a6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:32.035009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5058a-ae85-4056-9ce1-e3128e0e82a6 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:32.036851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 82/155] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:32.043027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8901b7-da45-4bc3-ac4b-42552f21422b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:32.043317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8901b7-da45-4bc3-ac4b-42552f21422b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:32.043596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8901b7-da45-4bc3-ac4b-42552f21422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:32.044330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805728a1-a31d-4d79-94c6-757baf237768 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:32.083820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2d8901b7-da45-4bc3-ac4b-42552f21422b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:32.085040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2d8901b7-da45-4bc3-ac4b-42552f21422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:32.086356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:32.087276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:32.087563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:32.087843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:32.089612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:32.091204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:32.092988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 74/156] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:31 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:32.108109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:32.148634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:32.189743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 83/157] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:32.232950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8901b7-da45-4bc3-ac4b-42552f21422b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:32.258743 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d684d78-f136-4966-8b30-e8f6060b5e13 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:32.310293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:32.311018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:32.311377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:32.311596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:32.312492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=f4d8dca6da814ed3aee97c9b23323a72) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:32.312730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:32.314181 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:32.325724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 75/158] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:32 2022] GET /identity/v3/role_assignments?user.id=f4d8dca6da814ed3aee97c9b23323a72&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=9987e14f9f4744858d584c8867b2a56c => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:32.406793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8901b7-da45-4bc3-ac4b-42552f21422b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:32.415034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:32.460189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:32.461488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:32.461969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:32.462438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:32.485410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:32.494470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:32.495968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:32.496738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:32.500211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 84/159] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:32.511847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:32.644147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:32.664960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf8501-09a4-4abd-be8c-459e453ad922 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:32.706230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:32.706946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:32.707236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:32.707521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:32.708288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:32.708601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:32.710017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:32.722222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 76/160] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:32.727762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:32.883393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16a25c-a7f8-4f40-9a6c-27c500848120 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:32.934442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b5470-d354-4997-81c7-775557daa6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:32.935691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b5470-d354-4997-81c7-775557daa6ae None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:32.936180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b5470-d354-4997-81c7-775557daa6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:32.936733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b5470-d354-4997-81c7-775557daa6ae None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:32.938202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b5470-d354-4997-81c7-775557daa6ae None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:32.939893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b5470-d354-4997-81c7-775557daa6ae None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:32.942066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 85/161] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:32 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:32.951811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:33.014908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d0eb-ec21-4c30-849e-b01c7005161f None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.015532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d0eb-ec21-4c30-849e-b01c7005161f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.016016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d0eb-ec21-4c30-849e-b01c7005161f None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.018018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 86/162] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:33.022754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc853c2-18e0-4e1e-8f96-58579dc93373 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.023278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc853c2-18e0-4e1e-8f96-58579dc93373 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.023774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc853c2-18e0-4e1e-8f96-58579dc93373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.052316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-afc853c2-18e0-4e1e-8f96-58579dc93373 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:33.053857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-afc853c2-18e0-4e1e-8f96-58579dc93373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:33.099886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.102888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962d611-c4d6-4b1d-9e01-ffe6dc12b2b2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:33.144809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:33.145468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.145754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.146032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.171306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.174749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 87/163] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:33.222549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc853c2-18e0-4e1e-8f96-58579dc93373 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:33.248333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:33.250169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:33.401699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc853c2-18e0-4e1e-8f96-58579dc93373 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:33.414755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 77/164] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:33.427875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:33.463845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6520288-1e00-4150-ad1d-bc9d9ba7d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:33.464858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6520288-1e00-4150-ad1d-bc9d9ba7d0bc None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.465141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6520288-1e00-4150-ad1d-bc9d9ba7d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.465414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6520288-1e00-4150-ad1d-bc9d9ba7d0bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.486909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6520288-1e00-4150-ad1d-bc9d9ba7d0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-a6520288-1e00-4150-ad1d-bc9d9ba7d0bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:33.502536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:33.503468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:33.504245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 88/165] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:33.506463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55f3c-c44e-492a-a9be-d4247a38cd9c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.506777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55f3c-c44e-492a-a9be-d4247a38cd9c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.507058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf55f3c-c44e-492a-a9be-d4247a38cd9c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.508526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 89/166] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:33.517145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf55f3c-c44e-492a-a9be-d4247a38cd9c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:33.517747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.571049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.598900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977342-8465-40c8-ae1c-c81a58e55285 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:33.637346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54dd56-3af6-4973-a14c-2288aa84c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:33.638217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54dd56-3af6-4973-a14c-2288aa84c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.638501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54dd56-3af6-4973-a14c-2288aa84c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.639246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54dd56-3af6-4973-a14c-2288aa84c9f0 None admin] PATH_INFO: `/v3/projects/67caeffa19ef4c04835570c2bf4bf553` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.640641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54dd56-3af6-4973-a14c-2288aa84c9f0 None admin] RBAC: Authorizing `identity:get_project(project_id=67caeffa19ef4c04835570c2bf4bf553)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:33.642181 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54dd56-3af6-4973-a14c-2288aa84c9f0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:33.644473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 78/167] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:33 2022] GET /identity/v3/projects/67caeffa19ef4c04835570c2bf4bf553 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:33.645637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabea1-77e2-4053-a095-207bbfb74568 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.645926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabea1-77e2-4053-a095-207bbfb74568 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.646204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabea1-77e2-4053-a095-207bbfb74568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.663643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-28fabea1-77e2-4053-a095-207bbfb74568 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:33.668521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-28fabea1-77e2-4053-a095-207bbfb74568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:33.769442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 79/168] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:33.770370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf55f3c-c44e-492a-a9be-d4247a38cd9c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:33.772886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fabea1-77e2-4053-a095-207bbfb74568 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:33.832454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:33.833663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:33.834947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:33.839908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:33.840921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:33.841472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:33.843132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:33.852765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.858093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 90/169] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:33.860670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:33.972814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fabea1-77e2-4053-a095-207bbfb74568 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:33.974429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:33.997251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534469-d274-4774-b830-20073368bdd9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:34.044103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8792a-fa42-4390-997b-10acfb28c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:34.044687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8792a-fa42-4390-997b-10acfb28c952 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.044967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8792a-fa42-4390-997b-10acfb28c952 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.045239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8792a-fa42-4390-997b-10acfb28c952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.046077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8792a-fa42-4390-997b-10acfb28c952 None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=67caeffa19ef4c04835570c2bf4bf553, user.id=f4d8dca6da814ed3aee97c9b23323a72) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:34.046385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8792a-fa42-4390-997b-10acfb28c952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:34.047878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8792a-fa42-4390-997b-10acfb28c952 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:34.061441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 80/170] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:33 2022] GET /identity/v3/role_assignments?user.id=f4d8dca6da814ed3aee97c9b23323a72&scope.project.id=67caeffa19ef4c04835570c2bf4bf553&role.id=9987e14f9f4744858d584c8867b2a56c => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:34.062777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930d8da-4eac-435a-b0a4-f909b904b9fb None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.063062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930d8da-4eac-435a-b0a4-f909b904b9fb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.063334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930d8da-4eac-435a-b0a4-f909b904b9fb None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.064573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 81/171] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:34.065258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930d8da-4eac-435a-b0a4-f909b904b9fb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:34.067294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4aa180-2898-4dba-a768-e0ec32d95d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:34.068115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa180-2898-4dba-a768-e0ec32d95d8d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.068389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa180-2898-4dba-a768-e0ec32d95d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.068657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4aa180-2898-4dba-a768-e0ec32d95d8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.089084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4aa180-2898-4dba-a768-e0ec32d95d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-2e4aa180-2898-4dba-a768-e0ec32d95d8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:34.101031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:34.101988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:34.102814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 91/172] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:34.104717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8bbe3-6cd3-4951-8f20-876ed7483186 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.104717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8bbe3-6cd3-4951-8f20-876ed7483186 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.104717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8bbe3-6cd3-4951-8f20-876ed7483186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.149012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b0b8bbe3-6cd3-4951-8f20-876ed7483186 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:34.150216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b0b8bbe3-6cd3-4951-8f20-876ed7483186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:34.299700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 92/173] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:34.300492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8bbe3-6cd3-4951-8f20-876ed7483186 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:34.301522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930d8da-4eac-435a-b0a4-f909b904b9fb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:34.319290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:34.382212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:34.383125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.383403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.383675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] PATH_INFO: `/v3/users/810ff4bb01dd49c79c0fe9e258d450e7` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.385840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] RBAC: Authorizing `identity:get_user(user_id=810ff4bb01dd49c79c0fe9e258d450e7)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:34.387363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:34.389087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 82/174] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:34 2022] GET /identity/v3/users/810ff4bb01dd49c79c0fe9e258d450e7 => generated 247 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:34.389879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:34.452871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:34.517076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8bbe3-6cd3-4951-8f20-876ed7483186 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:34.553740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f757b1-7281-4938-8ef5-0367435366cf None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:34.592076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:34.592516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.592806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.594008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.594008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:34.594220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:34.596590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:34.603226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d188fc-0e24-4795-8585-03bcbdcafb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:34.604580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d188fc-0e24-4795-8585-03bcbdcafb51 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.605057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d188fc-0e24-4795-8585-03bcbdcafb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.605508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d188fc-0e24-4795-8585-03bcbdcafb51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.605754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 93/175] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:34.607217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:34.628129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d188fc-0e24-4795-8585-03bcbdcafb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-48d188fc-0e24-4795-8585-03bcbdcafb51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:34.640582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:34.641459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:34.642224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 83/176] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:34.643364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff69a-0e8e-4edc-8e52-9626cd5b6ac3 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.643521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff69a-0e8e-4edc-8e52-9626cd5b6ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.644245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ff69a-0e8e-4edc-8e52-9626cd5b6ac3 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.645058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 84/177] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:34.645770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ff69a-0e8e-4edc-8e52-9626cd5b6ac3 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:34.690013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:34.748004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133c920-5282-48f7-a90f-30cfa7495428 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:34.776640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ff69a-0e8e-4edc-8e52-9626cd5b6ac3 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:34.784077 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e779c5-929a-4f72-9244-7f6d7882a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:34.784737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e779c5-929a-4f72-9244-7f6d7882a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.785022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e779c5-929a-4f72-9244-7f6d7882a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.785302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e779c5-929a-4f72-9244-7f6d7882a5d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.794379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:34.816558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c243ae6-9be3-4ff6-8128-5d9bd04e0003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:34.817360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c243ae6-9be3-4ff6-8128-5d9bd04e0003 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.817645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c243ae6-9be3-4ff6-8128-5d9bd04e0003 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.817920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c243ae6-9be3-4ff6-8128-5d9bd04e0003 None admin] PATH_INFO: `/v3/users/f4d8dca6da814ed3aee97c9b23323a72` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.819149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c243ae6-9be3-4ff6-8128-5d9bd04e0003 None admin] RBAC: Authorizing `identity:get_user(user_id=f4d8dca6da814ed3aee97c9b23323a72)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:34.820885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c243ae6-9be3-4ff6-8128-5d9bd04e0003 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:34.826803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 85/178] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:34 2022] GET /identity/v3/users/f4d8dca6da814ed3aee97c9b23323a72 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:34.826803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702b22-d3c2-45c7-8e3d-5f305b5bacd7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.826803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702b22-d3c2-45c7-8e3d-5f305b5bacd7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.826803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702b22-d3c2-45c7-8e3d-5f305b5bacd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.843116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-60702b22-d3c2-45c7-8e3d-5f305b5bacd7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:34.844320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-60702b22-d3c2-45c7-8e3d-5f305b5bacd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:34.865337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e779c5-929a-4f72-9244-7f6d7882a5d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:34.866941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e779c5-929a-4f72-9244-7f6d7882a5d4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:34.915212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 86/179] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:34.916295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60702b22-d3c2-45c7-8e3d-5f305b5bacd7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:34.948378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:34.988865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 94/180] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:34.990602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee3a30-8332-456b-afda-63af838061a0 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:34.990922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee3a30-8332-456b-afda-63af838061a0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:34.991202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee3a30-8332-456b-afda-63af838061a0 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:34.992649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 95/181] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:34.995478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee3a30-8332-456b-afda-63af838061a0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.024405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60702b22-d3c2-45c7-8e3d-5f305b5bacd7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.041920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.059095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.059764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.060049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.060328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.061081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:35.061389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.062834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.075482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 87/182] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:35.075482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.101884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee3a30-8332-456b-afda-63af838061a0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.135288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf58d9-6db9-4966-9a88-ee0cfe91cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.135931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf58d9-6db9-4966-9a88-ee0cfe91cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.136218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf58d9-6db9-4966-9a88-ee0cfe91cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.136494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf58d9-6db9-4966-9a88-ee0cfe91cf14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.164376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.172140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037489-77e5-4a2a-b77f-796b5f528760 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.203812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf58d9-6db9-4966-9a88-ee0cfe91cf14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.205287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf58d9-6db9-4966-9a88-ee0cfe91cf14 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.206047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.206906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.207190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.207466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.218077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:35.226138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:35.227084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:35.227885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:35.232216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 88/183] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:35.233093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.243015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.302481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 96/184] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:35.304154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b5a5-d3a1-4685-84a1-96c03708fd8f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.304453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b5a5-d3a1-4685-84a1-96c03708fd8f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.304732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b5a5-d3a1-4685-84a1-96c03708fd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.321189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a467b5a5-d3a1-4685-84a1-96c03708fd8f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:35.322386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a467b5a5-d3a1-4685-84a1-96c03708fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:35.332400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2015a5-71f0-4554-8a4f-d959c90444e6 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.365046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55ba2e-9406-4846-a97c-5d8882cf4fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.365891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55ba2e-9406-4846-a97c-5d8882cf4fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.366169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55ba2e-9406-4846-a97c-5d8882cf4fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.366441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55ba2e-9406-4846-a97c-5d8882cf4fb3 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.367651 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55ba2e-9406-4846-a97c-5d8882cf4fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.369109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55ba2e-9406-4846-a97c-5d8882cf4fb3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.371014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 89/185] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:35.371968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3dda1-abf9-49ee-ae4e-467d2c184205 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.372248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3dda1-abf9-49ee-ae4e-467d2c184205 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.372518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3dda1-abf9-49ee-ae4e-467d2c184205 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.373730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 90/186] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:35.375528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3dda1-abf9-49ee-ae4e-467d2c184205 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.392972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 97/187] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:35.393806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b5a5-d3a1-4685-84a1-96c03708fd8f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.400328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.459664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.481285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3dda1-abf9-49ee-ae4e-467d2c184205 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.497709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b5a5-d3a1-4685-84a1-96c03708fd8f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.514873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.515750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.516041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.516317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] PATH_INFO: `/v3/users/cc4026b1b365471b81ab4e9a43202a21` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.530395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4026b1b365471b81ab4e9a43202a21)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.531886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.532352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.533023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.533308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.533550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 91/188] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/users/cc4026b1b365471b81ab4e9a43202a21 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:35.533635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.534316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.534410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:35.534646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.536030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.544722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 98/189] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:35.545066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.616037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.635720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce48e3-3165-4703-82c1-7225982b9266 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.644711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab431ec-bb8a-433e-8898-34fe3a4387b4 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.669116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57144-cc6c-4fa1-9b0c-70913047c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.669964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57144-cc6c-4fa1-9b0c-70913047c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.670243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57144-cc6c-4fa1-9b0c-70913047c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.670517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57144-cc6c-4fa1-9b0c-70913047c8d7 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.671746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57144-cc6c-4fa1-9b0c-70913047c8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.671940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.673201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57144-cc6c-4fa1-9b0c-70913047c8d7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.674924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 92/190] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:35.676072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c097d5e-c646-4cc0-b2a3-c973952fa327 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.676359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c097d5e-c646-4cc0-b2a3-c973952fa327 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.676637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c097d5e-c646-4cc0-b2a3-c973952fa327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.683121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.683776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.684065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.684340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.685179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=810ff4bb01dd49c79c0fe9e258d450e7) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:35.685492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.686948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.692950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 99/191] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/role_assignments?user.id=810ff4bb01dd49c79c0fe9e258d450e7&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:35.693601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.695253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0c097d5e-c646-4cc0-b2a3-c973952fa327 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:35.696437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0c097d5e-c646-4cc0-b2a3-c973952fa327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:35.786712 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 93/192] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:35.786712 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c097d5e-c646-4cc0-b2a3-c973952fa327 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.815354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12890-245f-47e6-ab9d-4d089bfd2bcf None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.859149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.859982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.860264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.860640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.861821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:35.863334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:35.865285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 100/193] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:35.866123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:35.880200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.905587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c097d5e-c646-4cc0-b2a3-c973952fa327 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:35.939981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:35.940910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:35.941618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:35.941957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:35.942233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:35.978546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24efac5-e43b-4ce1-aac6-69d72a0822d2 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.009477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.011021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.011975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.012839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.013117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.013390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] PATH_INFO: `/v3/users/cc4026b1b365471b81ab4e9a43202a21` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.014622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] RBAC: Authorizing `identity:get_user(user_id=cc4026b1b365471b81ab4e9a43202a21)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.016063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.017695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 101/194] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/users/cc4026b1b365471b81ab4e9a43202a21 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:36.018447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.090830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.114107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11444e-ff9f-477e-a332-7a926ec5bcbe None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.118090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 94/195] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:36.118090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.144652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.151060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.151703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.151980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.152251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.153073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] RBAC: Adding query filter params (role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=f4d8dca6da814ed3aee97c9b23323a72) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:36.153388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.154837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.160815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 102/196] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/role_assignments?user.id=f4d8dca6da814ed3aee97c9b23323a72&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:36.163523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.223116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609673-6cc5-42b1-b8ae-bc751abe5f58 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.261686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.262509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.262825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.263106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.274870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:36.282990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:36.284125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 95/197] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:36.285133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.293954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879a8a-32e1-4aa3-bfc8-fd425d28fcab None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.334653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.335454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.336851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.336851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.336851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.337370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.339534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.362732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 103/198] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:08:36 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:36.363873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.422099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f9d1-89d4-4cb8-9e78-6590bc466529 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.433213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.461664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.462329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.462610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.462913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.502040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311b09-df40-4593-acfa-97c66b96e199 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.544676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.545296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.545386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.545664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.546609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.546991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.548120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.548443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.550373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 104/199] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:36.555137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.594294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.676606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 96/200] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:36.677206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.679788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd974a-5df5-495c-9d59-2a78eba27914 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.707078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.726713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.727427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.728143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.728425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.729488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:36.729797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.731979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.743635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 105/201] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:36.744933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.800599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c16485-af90-4cda-9ddb-e393d2f5e156 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.847015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.847799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.848242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.848523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.849681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=cc4026b1b365471b81ab4e9a43202a21) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:36.850000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.851516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.860195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 97/202] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/role_assignments?user.id=cc4026b1b365471b81ab4e9a43202a21&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:36.861608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.864348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faead0-be06-4392-844d-358cb91325d4 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:36.864690 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.906203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:36.907162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:36.907443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:36.907715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:36.909958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:36.910825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:36.912595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 106/203] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:36.918663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:36.976896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:36.985649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aa9d6-4d08-4819-beee-f98444b06a4e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:37.031655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:37.032824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:37.033259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:37.033681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] PATH_INFO: `/v3/users/1b16bcef608a4807a7d4d73dd3f7b284` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:37.038353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d100c4-15c6-451a-ad39-2098298df843 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:37.039406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] RBAC: Authorizing `identity:get_user(user_id=1b16bcef608a4807a7d4d73dd3f7b284)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:37.041072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:37.043385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 98/204] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/users/1b16bcef608a4807a7d4d73dd3f7b284 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:37.051665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:37.099152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:37.100027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:37.100457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:37.100839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:37.101881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] RBAC: Adding query filter params (role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=cc4026b1b365471b81ab4e9a43202a21) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:37.102299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:37.104066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:37.112184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 107/205] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:36 2022] GET /identity/v3/role_assignments?user.id=cc4026b1b365471b81ab4e9a43202a21&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:37.138508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:37.175928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea372-b74f-4a2c-9096-ad24bbd6a946 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:37.215864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:37.216766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:37.217198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:37.217621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:37.295522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:37.297279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:37.373476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:37.411426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 99/206] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:37.418718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:37.594175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be1704-ff18-4949-9dc3-0e5630acc67f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:37.621112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:37.661930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41250563-6f7e-4ef4-bc1c-46fabb36de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:37.662828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41250563-6f7e-4ef4-bc1c-46fabb36de2c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:37.663115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41250563-6f7e-4ef4-bc1c-46fabb36de2c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:37.663391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41250563-6f7e-4ef4-bc1c-46fabb36de2c None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:37.667519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41250563-6f7e-4ef4-bc1c-46fabb36de2c None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:37.668989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41250563-6f7e-4ef4-bc1c-46fabb36de2c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:37.671058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 108/207] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:37 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:37.676844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:37.830552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d6250-d461-46fd-afb2-4a623a7dd509 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:37.877334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d23a8-7c24-4c8b-988f-d74c0b6fa93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:37.878332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d23a8-7c24-4c8b-988f-d74c0b6fa93b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:37.878848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d23a8-7c24-4c8b-988f-d74c0b6fa93b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:37.879326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d23a8-7c24-4c8b-988f-d74c0b6fa93b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:37.880365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d23a8-7c24-4c8b-988f-d74c0b6fa93b None admin] RBAC: Adding query filter params (role.id=7af225d2412e4fb7bbc4156f193b37d0, scope.project.id=6f127d6bcfe64a2694256fed07561a95, user.id=1b16bcef608a4807a7d4d73dd3f7b284) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:37.880920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d23a8-7c24-4c8b-988f-d74c0b6fa93b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:37.882592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d23a8-7c24-4c8b-988f-d74c0b6fa93b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:37.889113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 100/208] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:37 2022] GET /identity/v3/role_assignments?user.id=1b16bcef608a4807a7d4d73dd3f7b284&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=7af225d2412e4fb7bbc4156f193b37d0 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:38.727287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac3e4-0d69-4673-b7f2-efd6c7ad2fa2 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:38.727822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac3e4-0d69-4673-b7f2-efd6c7ad2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:38.727822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ac3e4-0d69-4673-b7f2-efd6c7ad2fa2 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:38.729458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 109/209] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:38.734679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54dac-021b-432f-b33c-320f9f9605b7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:38.735086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54dac-021b-432f-b33c-320f9f9605b7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:38.735275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c54dac-021b-432f-b33c-320f9f9605b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:38.752545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f6c54dac-021b-432f-b33c-320f9f9605b7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:38.753669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f6c54dac-021b-432f-b33c-320f9f9605b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:38.769766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf53d7-50a6-4eba-a2f5-7f9ae3e43229 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:38.770054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf53d7-50a6-4eba-a2f5-7f9ae3e43229 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:38.770336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf53d7-50a6-4eba-a2f5-7f9ae3e43229 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:38.771740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 110/210] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:38.776730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf964-6e24-4fb3-b383-625eed0d173b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:38.777076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf964-6e24-4fb3-b383-625eed0d173b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:38.777362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf964-6e24-4fb3-b383-625eed0d173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:38.787935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:38.796152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c2bbf964-6e24-4fb3-b383-625eed0d173b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:38.797546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c2bbf964-6e24-4fb3-b383-625eed0d173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:38.834518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 101/211] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:38.857287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54dac-021b-432f-b33c-320f9f9605b7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:38.882081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 111/212] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:38.908562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf964-6e24-4fb3-b383-625eed0d173b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:38.969943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c54dac-021b-432f-b33c-320f9f9605b7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.007724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.008449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.008733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.009012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.020595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:39.028909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:39.029820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:39.030608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:39.034956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 102/213] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:39.035447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf964-6e24-4fb3-b383-625eed0d173b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.035787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.051080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:39.066190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:39.083689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.084715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.085591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.086018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.088103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:39.090011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:39.093041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 112/214] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:39.098255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.152662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1cc72-d62c-4da3-9cb0-cb30d863cc56 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.191082 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.191777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.192618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.192618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.193074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:39.193386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:39.194831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:39.204122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 103/215] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:39.209430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.231290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eba50-a5bd-4db6-a637-55dd3a5f0365 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.267990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db33df7-183b-45a7-952a-5fd7722cba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.268586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db33df7-183b-45a7-952a-5fd7722cba9e None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.268873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db33df7-183b-45a7-952a-5fd7722cba9e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.269157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db33df7-183b-45a7-952a-5fd7722cba9e None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.269994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db33df7-183b-45a7-952a-5fd7722cba9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:39.271571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db33df7-183b-45a7-952a-5fd7722cba9e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:39.301257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 113/216] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:08:39 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:08:39.316242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:39.334080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6d29f-2324-46ea-8776-03d0f65feb7a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.373380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.374279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.374563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.374887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] PATH_INFO: `/v3/users/9adc019457b44805a66462e5f0c2cfa2` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.391048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] RBAC: Authorizing `identity:get_user(user_id=9adc019457b44805a66462e5f0c2cfa2)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:39.391671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab063c3-bc14-4435-bbd5-0224b42c8d63 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.392171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab063c3-bc14-4435-bbd5-0224b42c8d63 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.392576 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:39.392879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab063c3-bc14-4435-bbd5-0224b42c8d63 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.398718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 104/217] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:39 2022] GET /identity/v3/users/9adc019457b44805a66462e5f0c2cfa2 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:39.398892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 114/218] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:39.401376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.405532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f014239-01c6-4d3f-9718-648872c33f98 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.405825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f014239-01c6-4d3f-9718-648872c33f98 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.406111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f014239-01c6-4d3f-9718-648872c33f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.423277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2f014239-01c6-4d3f-9718-648872c33f98 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:39.424497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2f014239-01c6-4d3f-9718-648872c33f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:39.463669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:39.530796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 115/219] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:39.530983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b6ba5-66d7-4005-ba9b-3f2e41aeaaec None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.548093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f014239-01c6-4d3f-9718-648872c33f98 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.572677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.574210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.574706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.575198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.591380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:39.657897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:39.659440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:39.668839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f014239-01c6-4d3f-9718-648872c33f98 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.706038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984d17b-d394-44b0-b246-a55d34a16c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.707062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d17b-d394-44b0-b246-a55d34a16c16 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.707350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d17b-d394-44b0-b246-a55d34a16c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.707627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984d17b-d394-44b0-b246-a55d34a16c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.718318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984d17b-d394-44b0-b246-a55d34a16c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-1984d17b-d394-44b0-b246-a55d34a16c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:39.726039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:39.726950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:39.728179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 116/220] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:39.730242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942fde4-d87c-43db-b1cc-693ef3210e0c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.730242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942fde4-d87c-43db-b1cc-693ef3210e0c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.730242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942fde4-d87c-43db-b1cc-693ef3210e0c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.731098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 117/221] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:39.736540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0df72-36dd-4005-98f2-8fa3a0237de4 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.736828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0df72-36dd-4005-98f2-8fa3a0237de4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.737111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0df72-36dd-4005-98f2-8fa3a0237de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.756298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bfc0df72-36dd-4005-98f2-8fa3a0237de4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:39.757511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bfc0df72-36dd-4005-98f2-8fa3a0237de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:39.777520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:39.784144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 105/222] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:08:39.784959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.839155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:39.846054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 118/223] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:39.846961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0df72-36dd-4005-98f2-8fa3a0237de4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.922499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf9f9-b1cd-4493-81e2-a1c868a0ceb3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:39.964049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:39.964411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:39.964693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:39.964963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:39.965722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:39.966045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:39.967532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:39.976922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 106/224] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:39.977753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:39.978396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0df72-36dd-4005-98f2-8fa3a0237de4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.015992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.017140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.017592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.018059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.019436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.021127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.023542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 119/225] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:39 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:40.024613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.050873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:40.091542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de473-ec9f-4e98-8157-d3db9244844f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.100134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:40.138480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.139689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.140049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690e495-86d1-4153-a5cd-5d0fdfba5014 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.140398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.140863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.155302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:40.165772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:40.167352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:40.168125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:40.168701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 107/226] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:40.169814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.186172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.187403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.187694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.187983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] PATH_INFO: `/v3/users/cc4026b1b365471b81ab4e9a43202a21` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.189404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4026b1b365471b81ab4e9a43202a21)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.191064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.194751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 120/227] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:40 2022] GET /identity/v3/users/cc4026b1b365471b81ab4e9a43202a21 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:40.196111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.304069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7452e8-e417-46a6-b37a-1791897c8790 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.315892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:40.327990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b20e3-74a2-400e-bc66-a919dac35174 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.339384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.339792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.340071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.340347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.341190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=9adc019457b44805a66462e5f0c2cfa2) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:40.341505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.343028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.349008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 108/228] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:40 2022] GET /identity/v3/role_assignments?user.id=9adc019457b44805a66462e5f0c2cfa2&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=9987e14f9f4744858d584c8867b2a56c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:40.349607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.369876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.370967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.371473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.372040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.373122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:40.373644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.375310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.385786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:40.387138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 121/229] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:40.392742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.467130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4efe7-3584-4386-8bed-c6a1f23b4204 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.516913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.518183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.518809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.519496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.521137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.522850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.525263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 109/230] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:40 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:40.531838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.567385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9488b-e50f-498e-9cb3-aa17f463dd5c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.606857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.607616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.607964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.608338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] PATH_INFO: `/v3/users/cc4026b1b365471b81ab4e9a43202a21` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.609631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4026b1b365471b81ab4e9a43202a21)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.611955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.613533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 122/231] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:40 2022] GET /identity/v3/users/cc4026b1b365471b81ab4e9a43202a21 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:40.618531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.644393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:40.646241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:40.650484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248d33-825f-4fee-a08f-c3248cd35d8f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.689352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.690521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.690979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.691400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/cc4026b1b365471b81ab4e9a43202a21/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.693564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c026b061f24637b96eff8ca60b86cb, user_id=cc4026b1b365471b81ab4e9a43202a21, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.695566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.712501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 110/232] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:40 2022] PUT /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/cc4026b1b365471b81ab4e9a43202a21/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:08:40.743655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1ff7d-3ce2-45ca-95be-43f07555fda6 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.783679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0abd1-0c44-4698-b5d4-b08876db62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.784562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0abd1-0c44-4698-b5d4-b08876db62d0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.784840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0abd1-0c44-4698-b5d4-b08876db62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.785113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0abd1-0c44-4698-b5d4-b08876db62d0 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.786332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0abd1-0c44-4698-b5d4-b08876db62d0 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.787903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0abd1-0c44-4698-b5d4-b08876db62d0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.789781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 123/233] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:40 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:40.796473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:40.913569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898730aa-f2c1-4ce8-9121-9c20fbc80f46 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:40.951702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b23e0-07e5-4b6d-add4-958cfe48a0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:40.952843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b23e0-07e5-4b6d-add4-958cfe48a0f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:40.953273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b23e0-07e5-4b6d-add4-958cfe48a0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:40.953696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b23e0-07e5-4b6d-add4-958cfe48a0f4 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/cc4026b1b365471b81ab4e9a43202a21/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:40.956161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b23e0-07e5-4b6d-add4-958cfe48a0f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c026b061f24637b96eff8ca60b86cb, user_id=cc4026b1b365471b81ab4e9a43202a21, role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:40.957769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b23e0-07e5-4b6d-add4-958cfe48a0f4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:40.974814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 111/234] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:40 2022] PUT /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/cc4026b1b365471b81ab4e9a43202a21/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:41.783834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121371-2347-4275-b834-5ddcdbad987e None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:41.784338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121371-2347-4275-b834-5ddcdbad987e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:41.784338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46121371-2347-4275-b834-5ddcdbad987e None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:41.786023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 124/235] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:41.791473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f827-7212-4f81-a6a0-69cfe8a68797 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:41.792481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f827-7212-4f81-a6a0-69cfe8a68797 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:41.792763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f827-7212-4f81-a6a0-69cfe8a68797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:41.815670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ec64f827-7212-4f81-a6a0-69cfe8a68797 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:41.816875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ec64f827-7212-4f81-a6a0-69cfe8a68797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:41.831781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:41.904884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 112/236] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:41.940799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121371-2347-4275-b834-5ddcdbad987e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:42.066222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:42.087906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46121371-2347-4275-b834-5ddcdbad987e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:42.136425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdec0cf-d9e9-414c-8343-f6cc4c71affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:42.137218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec0cf-d9e9-414c-8343-f6cc4c71affd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.137495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec0cf-d9e9-414c-8343-f6cc4c71affd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.137764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec0cf-d9e9-414c-8343-f6cc4c71affd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:42.155526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdec0cf-d9e9-414c-8343-f6cc4c71affd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ecdec0cf-d9e9-414c-8343-f6cc4c71affd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:42.163223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:42.164097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:42.164869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 125/237] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:42.172228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f827-7212-4f81-a6a0-69cfe8a68797 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:42.293675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601d07-23c3-416d-95c4-5a7f43a47a11 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.294723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601d07-23c3-416d-95c4-5a7f43a47a11 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.295505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601d07-23c3-416d-95c4-5a7f43a47a11 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:42.297941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 126/238] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:42.300077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f827-7212-4f81-a6a0-69cfe8a68797 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:42.302622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447e01e-1b23-42a3-a9f5-f1c21ebd64db None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.303278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447e01e-1b23-42a3-a9f5-f1c21ebd64db None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.303759 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447e01e-1b23-42a3-a9f5-f1c21ebd64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:42.324323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e447e01e-1b23-42a3-a9f5-f1c21ebd64db None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:42.326140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e447e01e-1b23-42a3-a9f5-f1c21ebd64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:42.372065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:42.372736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.373014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.373285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:42.374031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:42.374336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:42.375766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:42.392995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 113/239] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:42.401916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:42.431045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:42.452972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 127/240] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:42.477198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447e01e-1b23-42a3-a9f5-f1c21ebd64db None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:42.585115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32737a-99b7-4915-af4d-adcac3338865 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:42.602146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:42.626309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447e01e-1b23-42a3-a9f5-f1c21ebd64db None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:42.662485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:42.663645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.664129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.664603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:42.666027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:42.668275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:42.670112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 128/241] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:42.670285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:42.674669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.674669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.674669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] PATH_INFO: `/v3/users/842c5818f2304851aafd347f7e6cd962` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:42.675937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:42.700395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=842c5818f2304851aafd347f7e6cd962)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:42.701940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:42.703986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 114/242] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:42 2022] GET /identity/v3/users/842c5818f2304851aafd347f7e6cd962 => generated 297 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:42.709408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:42.784363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720c9d7-f0c6-49fd-b5a7-a1e7bcb37d55 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:42.821213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ad13a-3de2-44a8-a966-88f37598a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:42.822330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ad13a-3de2-44a8-a966-88f37598a752 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.823384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ad13a-3de2-44a8-a966-88f37598a752 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.823858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ad13a-3de2-44a8-a966-88f37598a752 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:42.824792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ad13a-3de2-44a8-a966-88f37598a752 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:42.826548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ad13a-3de2-44a8-a966-88f37598a752 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:42.851870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 129/243] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:08:42 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:42.860267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:42.925347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ef5c-7622-40a7-aa24-c6062cd2d2b3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:42.981963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c9f38-28b9-4477-80e5-cdec7ba34c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:42.982636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9f38-28b9-4477-80e5-cdec7ba34c1a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:42.982941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9f38-28b9-4477-80e5-cdec7ba34c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:42.983215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c9f38-28b9-4477-80e5-cdec7ba34c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.021951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74850-f032-484a-bf03-00a3ff065b5d None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.022261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74850-f032-484a-bf03-00a3ff065b5d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.022528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e74850-f032-484a-bf03-00a3ff065b5d None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.024060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 130/244] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:43.029750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acd70e-6848-4b09-be80-b5b890fc0260 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.030261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acd70e-6848-4b09-be80-b5b890fc0260 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.030814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acd70e-6848-4b09-be80-b5b890fc0260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.038669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:43.059635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f2acd70e-6848-4b09-be80-b5b890fc0260 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:43.061337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f2acd70e-6848-4b09-be80-b5b890fc0260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:43.084901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9f38-28b9-4477-80e5-cdec7ba34c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:43.086753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c9f38-28b9-4477-80e5-cdec7ba34c1a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:43.160176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 131/245] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:43.178747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:43.186143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acd70e-6848-4b09-be80-b5b890fc0260 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:43.228899 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 115/246] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:43.230413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e759d-f67b-469f-9273-340336d42588 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.230729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e759d-f67b-469f-9273-340336d42588 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.231007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e759d-f67b-469f-9273-340336d42588 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.232294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 116/247] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:43.237673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e759d-f67b-469f-9273-340336d42588 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:43.311111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acd70e-6848-4b09-be80-b5b890fc0260 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:43.346898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:43.354271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e759d-f67b-469f-9273-340336d42588 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:43.354824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b7d50-ea46-4b47-b937-77018f0290ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:43.355627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7d50-ea46-4b47-b937-77018f0290ce None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.356076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7d50-ea46-4b47-b937-77018f0290ce None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.356360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b7d50-ea46-4b47-b937-77018f0290ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.371545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b7d50-ea46-4b47-b937-77018f0290ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c43b7d50-ea46-4b47-b937-77018f0290ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:43.381982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:43.383015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:43.383787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:43.384385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 132/248] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:43.386234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e71fcb-ca0f-4e49-857b-b43fa8a2b46a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.386522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e71fcb-ca0f-4e49-857b-b43fa8a2b46a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.387196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e71fcb-ca0f-4e49-857b-b43fa8a2b46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.391554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:43.392776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.393126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.393474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.394812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:43.396382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:43.398484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 117/249] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:43 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:43.399353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:43.406224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c5e71fcb-ca0f-4e49-857b-b43fa8a2b46a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:43.407713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c5e71fcb-ca0f-4e49-857b-b43fa8a2b46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:43.443677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:43.511223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 133/250] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:43.512497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e71fcb-ca0f-4e49-857b-b43fa8a2b46a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:43.525943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7db0-3836-4b8b-8afc-7e6ca57bfe0b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:43.566095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:43.567182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.568122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.568710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.573036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:43.573725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:43.575800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:43.586287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 118/251] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:43.587765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:43.700068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:43.704440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c24111-7f8b-4823-965d-c54367446093 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:43.706236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e71fcb-ca0f-4e49-857b-b43fa8a2b46a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:43.731949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:43.742545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:43.743454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.743898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.744402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.745720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0c067-76ea-4b37-8dce-d38881c4a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:43.746158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] RBAC: Adding query filter params (role.id=7af225d2412e4fb7bbc4156f193b37d0, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=842c5818f2304851aafd347f7e6cd962) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:43.746516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c067-76ea-4b37-8dce-d38881c4a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.746625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:43.746833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c067-76ea-4b37-8dce-d38881c4a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.747113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c067-76ea-4b37-8dce-d38881c4a6b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.748577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:43.754762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 134/252] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:43 2022] GET /identity/v3/role_assignments?user.id=842c5818f2304851aafd347f7e6cd962&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=7af225d2412e4fb7bbc4156f193b37d0 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:43.755687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:43.758358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0c067-76ea-4b37-8dce-d38881c4a6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-72c0c067-76ea-4b37-8dce-d38881c4a6b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:43.766564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:43.767659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:43.768643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 119/253] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:43.774054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a618-63d3-4f04-a3a2-491c7a1d450f None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.774355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a618-63d3-4f04-a3a2-491c7a1d450f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.774637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a618-63d3-4f04-a3a2-491c7a1d450f None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.776052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 120/254] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:43.777171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98a618-63d3-4f04-a3a2-491c7a1d450f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:43.927016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954193-e9cc-4ba7-8128-35a937cefd58 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:43.964964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98a618-63d3-4f04-a3a2-491c7a1d450f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:43.967573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6e842-bb2f-4161-be63-e86682a430d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:43.968460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6e842-bb2f-4161-be63-e86682a430d0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.968742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6e842-bb2f-4161-be63-e86682a430d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.969021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6e842-bb2f-4161-be63-e86682a430d0 None admin] PATH_INFO: `/v3/users/9adc019457b44805a66462e5f0c2cfa2` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.970238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6e842-bb2f-4161-be63-e86682a430d0 None admin] RBAC: Authorizing `identity:get_user(user_id=9adc019457b44805a66462e5f0c2cfa2)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:43.971725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6e842-bb2f-4161-be63-e86682a430d0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:43.973390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 135/255] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:43 2022] GET /identity/v3/users/9adc019457b44805a66462e5f0c2cfa2 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:43.974551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2210-c31f-4792-a959-0888dc4ce0df None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:43.974964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2210-c31f-4792-a959-0888dc4ce0df None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:43.975239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2210-c31f-4792-a959-0888dc4ce0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:43.996940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-927f2210-c31f-4792-a959-0888dc4ce0df None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:43.998215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-927f2210-c31f-4792-a959-0888dc4ce0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:44.047951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:44.048635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:44.048919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:44.049196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:44.049955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:44.050265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:44.051204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:44.051688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:44.070789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 136/256] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:44.071456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2210-c31f-4792-a959-0888dc4ce0df None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:44.075883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 121/257] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:44.082939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:44.115073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:44.201179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbeb662-ab5a-4052-9ca1-c7457b6285f6 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:44.242609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82878504-346c-4202-9a95-566f40cf76af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:44.243448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878504-346c-4202-9a95-566f40cf76af None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:44.243880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878504-346c-4202-9a95-566f40cf76af None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:44.244173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878504-346c-4202-9a95-566f40cf76af None admin] PATH_INFO: `/v3/users/cc4026b1b365471b81ab4e9a43202a21` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:44.245460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82878504-346c-4202-9a95-566f40cf76af None admin] RBAC: Authorizing `identity:get_user(user_id=cc4026b1b365471b81ab4e9a43202a21)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:44.247086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82878504-346c-4202-9a95-566f40cf76af None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:44.249039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 122/258] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:44 2022] GET /identity/v3/users/cc4026b1b365471b81ab4e9a43202a21 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:44.249890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82878504-346c-4202-9a95-566f40cf76af None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:44.334706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2210-c31f-4792-a959-0888dc4ce0df None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:44.367056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:44.376868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:44.377734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:44.378015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:44.378292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:44.379513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:44.380994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:44.382883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 137/259] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:44 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:44.384088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82878504-346c-4202-9a95-566f40cf76af None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:44.390309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:44.444775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:44.456030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:44.456877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:44.457334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:44.457881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:44.483272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:44.499821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:44.500729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:44.501526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 123/260] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:44.502828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:44.511059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5f4a-ea15-4ff6-a1e0-8c7b80dc1c19 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:44.573883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:44.574545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:44.574855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:44.575136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:44.615548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6ec7-9401-434f-8039-59a2196709b1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:44.659602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:44.660499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:44.660782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:44.661060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/9adc019457b44805a66462e5f0c2cfa2/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:44.663927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c026b061f24637b96eff8ca60b86cb, user_id=9adc019457b44805a66462e5f0c2cfa2, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:44.665641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:44.692891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 124/261] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:44 2022] PUT /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/9adc019457b44805a66462e5f0c2cfa2/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:44.694812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:44.717505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:44.717697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:44.719194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:44.838936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff66af3-b5bb-4444-8b09-34e666601159 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:44.849804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:44.901169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:44.901861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:44.902144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:44.902423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:44.903322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:44.903638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:44.905056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:44.925171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 125/262] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:44.930933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:44.950366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 138/263] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:44.955864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:45.018324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:45.080546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b0757-6569-4315-9e80-24c79dfc4f8e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:45.138403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c89fc-074a-471e-9e20-199cd7a83134 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:45.148059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c984-746a-4743-8369-823177e15874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:45.149189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c984-746a-4743-8369-823177e15874 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.149517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c984-746a-4743-8369-823177e15874 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.149808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c984-746a-4743-8369-823177e15874 None admin] PATH_INFO: `/v3/users/cc4026b1b365471b81ab4e9a43202a21` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.154711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c984-746a-4743-8369-823177e15874 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4026b1b365471b81ab4e9a43202a21)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:45.154711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c984-746a-4743-8369-823177e15874 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:45.156754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 126/264] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:44 2022] GET /identity/v3/users/cc4026b1b365471b81ab4e9a43202a21 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:45.162309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c984-746a-4743-8369-823177e15874 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:45.223487 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:45.224731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.225302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.225788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.227261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:45.229437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:45.231703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 139/265] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:44 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:45.237307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:45.285178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:45.305822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c984-746a-4743-8369-823177e15874 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:45.354782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:45.355450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.355732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.356005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.383065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:45.461339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72834a2-5981-469f-b7a0-d789c4869583 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:45.512116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:45.513620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:45.537151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:45.537809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.538090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.538367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.539230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=cc4026b1b365471b81ab4e9a43202a21) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:45.539547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:45.540995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:45.558724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 140/266] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:45 2022] GET /identity/v3/role_assignments?user.id=cc4026b1b365471b81ab4e9a43202a21&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:45.642423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 127/267] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:45.647988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:45.739231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:45.756926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828bd56-2f38-4e3f-a1e0-21ddc66ac080 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:45.793964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2a838-f3a2-48db-bef7-006413ff9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:45.794875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a838-f3a2-48db-bef7-006413ff9f5a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.795161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a838-f3a2-48db-bef7-006413ff9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.795436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a838-f3a2-48db-bef7-006413ff9f5a None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.796691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2a838-f3a2-48db-bef7-006413ff9f5a None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:45.798175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2a838-f3a2-48db-bef7-006413ff9f5a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:45.800295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 141/268] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:45 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:45.806123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:45.859178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376aea-e233-4d95-aa49-57762f2916a8 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.859501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376aea-e233-4d95-aa49-57762f2916a8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.859741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376aea-e233-4d95-aa49-57762f2916a8 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.860193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:45.861689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 142/269] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:45.868589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b772ef-c721-4bc7-bb7c-be04389d7931 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.868879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b772ef-c721-4bc7-bb7c-be04389d7931 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.869163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b772ef-c721-4bc7-bb7c-be04389d7931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.892803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f7b772ef-c721-4bc7-bb7c-be04389d7931 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:45.894014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f7b772ef-c721-4bc7-bb7c-be04389d7931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:45.930089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7c010-9962-4a97-9286-fbe54c6fbac7 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:45.971794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:45.972802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.973300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.973761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.974861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] RBAC: Adding query filter params (role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=cc4026b1b365471b81ab4e9a43202a21) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:45.975371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:45.977705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:45.979785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 143/270] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:45.981235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd209888-35ce-4132-9031-f9488cac8a53 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.981525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd209888-35ce-4132-9031-f9488cac8a53 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.981799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd209888-35ce-4132-9031-f9488cac8a53 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.986754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 144/271] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:45.989295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845fbc5-dd13-4d51-817b-0fcd5e2ae92d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:45.989526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845fbc5-dd13-4d51-817b-0fcd5e2ae92d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:45.989814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845fbc5-dd13-4d51-817b-0fcd5e2ae92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:45.992154 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 128/272] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:45 2022] GET /identity/v3/role_assignments?user.id=cc4026b1b365471b81ab4e9a43202a21&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:46.011263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:46.019873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2845fbc5-dd13-4d51-817b-0fcd5e2ae92d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:46.021093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2845fbc5-dd13-4d51-817b-0fcd5e2ae92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:46.126147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdab8-1e65-47a8-8fe7-556eef76dce4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:46.128447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:46.132494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 145/273] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:46.166117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845fbc5-dd13-4d51-817b-0fcd5e2ae92d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:46.170922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:46.171978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.172454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.172921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.186226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:46.191075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:46.195650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:46.196572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:46.197407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 129/274] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:46.204085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:46.314846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae2e30-7343-4717-bd31-12b6dd23b815 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:46.352815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:46.353487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.353766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.354079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.354267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845fbc5-dd13-4d51-817b-0fcd5e2ae92d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:46.354862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:46.355168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:46.356574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:46.366141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 130/275] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:46.371946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:46.399956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:46.415523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:46.416348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.416633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.416905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.418102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:46.419694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:46.421635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 146/276] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:46.427075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:46.484653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b717d-4038-40e1-8044-2e79945a0d02 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:46.521632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836eddb-57bc-4e63-90a7-661b324aea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:46.522643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836eddb-57bc-4e63-90a7-661b324aea25 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.523043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836eddb-57bc-4e63-90a7-661b324aea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.523384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836eddb-57bc-4e63-90a7-661b324aea25 None admin] PATH_INFO: `/v3/users/f7acddcc1d6e4c2589f99723c80e8c35` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.523889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:46.539353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836eddb-57bc-4e63-90a7-661b324aea25 None admin] RBAC: Authorizing `identity:get_user(user_id=f7acddcc1d6e4c2589f99723c80e8c35)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:46.541210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836eddb-57bc-4e63-90a7-661b324aea25 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:46.544043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 131/277] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:46 2022] GET /identity/v3/users/f7acddcc1d6e4c2589f99723c80e8c35 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:46.544162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70ed0e-3d09-4345-b7ea-98cec3985cd0 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:46.545165 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf155-709c-4ee5-95b7-7e6c7901077f None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.545449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf155-709c-4ee5-95b7-7e6c7901077f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.545722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caf155-709c-4ee5-95b7-7e6c7901077f None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.551809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 132/278] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:46.552476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf155-709c-4ee5-95b7-7e6c7901077f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:46.589147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4aa27-5f78-411c-8274-8ee6abf3746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:46.590124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4aa27-5f78-411c-8274-8ee6abf3746a None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.590582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4aa27-5f78-411c-8274-8ee6abf3746a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.591135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4aa27-5f78-411c-8274-8ee6abf3746a None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.591865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4aa27-5f78-411c-8274-8ee6abf3746a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:46.593425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4aa27-5f78-411c-8274-8ee6abf3746a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:46.623821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 147/279] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:08:46 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:46.624923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db7a0e-7c50-4b6a-9a24-5ac83f52f97d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.625218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db7a0e-7c50-4b6a-9a24-5ac83f52f97d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.625499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db7a0e-7c50-4b6a-9a24-5ac83f52f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.657684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e9db7a0e-7c50-4b6a-9a24-5ac83f52f97d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:46.660479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e9db7a0e-7c50-4b6a-9a24-5ac83f52f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:46.664866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:46.691425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caf155-709c-4ee5-95b7-7e6c7901077f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:46.737409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:46.738074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.738354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.738632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.739532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, user.id=f7acddcc1d6e4c2589f99723c80e8c35, scope.system=all) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:46.739840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:46.741507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:46.753034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 133/280] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 30 10:08:46 2022] GET /identity/v3/role_assignments?user.id=f7acddcc1d6e4c2589f99723c80e8c35&scope.system=all&role.id=9987e14f9f4744858d584c8867b2a56c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:46.767392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 148/281] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:46.790549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:46.911200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50489eb-7009-45b7-ba8b-48217dd4fe14 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:46.948826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:46.949906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:46.950335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:46.950774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:46.962183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:46.970264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:46.971368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:46.972306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:46.974081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 134/282] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:46.980026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db7a0e-7c50-4b6a-9a24-5ac83f52f97d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:47.071654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:47.126142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db7a0e-7c50-4b6a-9a24-5ac83f52f97d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:47.176289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:47.176903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:47.177190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:47.177471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:47.178228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:47.178539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:47.179969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:47.194865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 149/283] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:47.201233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:47.215673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:47.334769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e7bc1-7fdb-4e76-8fdc-cfec565f37aa None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:47.378355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5708d-4833-47ff-92ac-9840eb255845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:47.379237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5708d-4833-47ff-92ac-9840eb255845 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:47.379522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5708d-4833-47ff-92ac-9840eb255845 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:47.379794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5708d-4833-47ff-92ac-9840eb255845 None admin] PATH_INFO: `/v3/users/842c5818f2304851aafd347f7e6cd962` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:47.381041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5708d-4833-47ff-92ac-9840eb255845 None admin] RBAC: Authorizing `identity:get_user(user_id=842c5818f2304851aafd347f7e6cd962)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:47.382512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5708d-4833-47ff-92ac-9840eb255845 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:47.384362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 135/284] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:47 2022] GET /identity/v3/users/842c5818f2304851aafd347f7e6cd962 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:47.391619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:47.553319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab627-8d10-42bb-ac73-4ba37e808fcb None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:47.553668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab627-8d10-42bb-ac73-4ba37e808fcb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:47.553867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab627-8d10-42bb-ac73-4ba37e808fcb None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:47.555296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 136/285] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:47.563214 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf576d-02a5-4987-ba7c-261a30398d7e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:47.563501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf576d-02a5-4987-ba7c-261a30398d7e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:47.563781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf576d-02a5-4987-ba7c-261a30398d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:47.589640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-40cf576d-02a5-4987-ba7c-261a30398d7e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:47.590888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-40cf576d-02a5-4987-ba7c-261a30398d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:47.594844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84547-65a5-4878-b2d7-f7ef46b2df07 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:47.647542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:47.663271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:47.664143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:47.664424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:47.664703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:47.667348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:47.668924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:47.670904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 150/286] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:47 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:47.678467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:47.733596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 137/287] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:47.795811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf576d-02a5-4987-ba7c-261a30398d7e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:47.803975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:47.845819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027560f-662f-432a-9d45-6aaa613c9edd None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:47.917283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:47.918209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:47.918487 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:47.918780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/842c5818f2304851aafd347f7e6cd962/roles/7af225d2412e4fb7bbc4156f193b37d0` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:47.922389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c026b061f24637b96eff8ca60b86cb, user_id=842c5818f2304851aafd347f7e6cd962, role_id=7af225d2412e4fb7bbc4156f193b37d0)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:47.923859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:47.951455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 151/288] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:08:47 2022] PUT /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb/users/842c5818f2304851aafd347f7e6cd962/roles/7af225d2412e4fb7bbc4156f193b37d0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:47.977220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf576d-02a5-4987-ba7c-261a30398d7e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:48.016596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:48.017444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:48.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:48.018379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:48.030641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:48.038905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:48.039948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:48.041041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 138/289] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:48.047525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:48.112636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:48.176925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef0cd-1e86-48b2-8ae6-2a1f537b2763 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:48.226430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:48.227136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:48.227416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:48.227686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:48.228441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:48.228740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:48.230844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:48.243905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 152/290] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:48.249755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:48.322782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:48.369001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133470a-f00e-4a47-8dca-bdcac3be2b60 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:48.405317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:48.406189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:48.406470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:48.406761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] PATH_INFO: `/v3/users/9adc019457b44805a66462e5f0c2cfa2` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:48.411679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] RBAC: Authorizing `identity:get_user(user_id=9adc019457b44805a66462e5f0c2cfa2)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:48.413232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:48.415075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 139/291] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:48 2022] GET /identity/v3/users/9adc019457b44805a66462e5f0c2cfa2 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:48.420992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:48.581784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95cbc9-c841-416f-8161-251f2f9bbffb None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:48.599106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:48.625893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:48.626629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:48.626950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:48.627231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:48.714642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:48.716139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:48.840495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 153/292] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:48.845863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:48.949465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8b8ed-fdd2-403c-b54b-1167f783753b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:48.979449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:48.984742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5545631-9577-4199-9ca9-54dc99f55146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:48.985611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5545631-9577-4199-9ca9-54dc99f55146 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:48.985888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5545631-9577-4199-9ca9-54dc99f55146 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:48.986163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5545631-9577-4199-9ca9-54dc99f55146 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:48.987971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5545631-9577-4199-9ca9-54dc99f55146 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:48.989870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5545631-9577-4199-9ca9-54dc99f55146 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:48.991606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 140/293] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:48 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:48.997551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:49.016916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:49.103134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008c81a-558d-4a00-9388-7e37b6424cda None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:49.139680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda91cc6-1be7-45c8-bc0e-eb7f0e0c8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:49.140329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda91cc6-1be7-45c8-bc0e-eb7f0e0c8872 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.140608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda91cc6-1be7-45c8-bc0e-eb7f0e0c8872 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.140882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda91cc6-1be7-45c8-bc0e-eb7f0e0c8872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.141708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda91cc6-1be7-45c8-bc0e-eb7f0e0c8872 None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=9adc019457b44805a66462e5f0c2cfa2) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:49.142019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda91cc6-1be7-45c8-bc0e-eb7f0e0c8872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:49.143482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda91cc6-1be7-45c8-bc0e-eb7f0e0c8872 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:49.149912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 154/294] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:48 2022] GET /identity/v3/role_assignments?user.id=9adc019457b44805a66462e5f0c2cfa2&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=9987e14f9f4744858d584c8867b2a56c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:49.345699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a862-5cab-40be-b933-e650f87d07fb None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.346236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a862-5cab-40be-b933-e650f87d07fb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.346236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a862-5cab-40be-b933-e650f87d07fb None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.347864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 141/295] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:49.364930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019aec-706e-474c-b89c-c56e14462274 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.365211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019aec-706e-474c-b89c-c56e14462274 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.365423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019aec-706e-474c-b89c-c56e14462274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.389654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-03019aec-706e-474c-b89c-c56e14462274 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:49.390877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-03019aec-706e-474c-b89c-c56e14462274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:49.468543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 155/296] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:49.492788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a862-5cab-40be-b933-e650f87d07fb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:49.536253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37989-b1be-4224-ab90-2a795fc98433 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.536568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37989-b1be-4224-ab90-2a795fc98433 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.536805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37989-b1be-4224-ab90-2a795fc98433 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.538321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 156/297] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:49.544522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee6c1c-c137-4fd5-82e7-1356f298f481 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.545109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee6c1c-c137-4fd5-82e7-1356f298f481 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.545498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee6c1c-c137-4fd5-82e7-1356f298f481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.564689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f4ee6c1c-c137-4fd5-82e7-1356f298f481 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:49.566145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f4ee6c1c-c137-4fd5-82e7-1356f298f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:49.579030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:49.617233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a862-5cab-40be-b933-e650f87d07fb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:49.652358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 157/298] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:49.653518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5573a2-5bb9-42ae-a36b-891d129f392a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.653804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5573a2-5bb9-42ae-a36b-891d129f392a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.654170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5573a2-5bb9-42ae-a36b-891d129f392a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.655633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 158/299] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:49.660885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad02e-a938-472a-9da7-ba6b4478d303 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.661170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad02e-a938-472a-9da7-ba6b4478d303 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.661446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad02e-a938-472a-9da7-ba6b4478d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.666362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:49.667183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.667462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.667735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.681078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:49.683940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b12ad02e-a938-472a-9da7-ba6b4478d303 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:49.685398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b12ad02e-a938-472a-9da7-ba6b4478d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:49.690185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:49.691101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 142/300] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:49.697275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:49.758308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:49.770726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 159/301] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:49.770726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ad02e-a938-472a-9da7-ba6b4478d303 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:49.807107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c8a19-2745-4065-a53c-8d992b506c78 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:49.845328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:49.847989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:49.848786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.849072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.849348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.862457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:49.873849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:49.875034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:49.875842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 143/302] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:49.876502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ad02e-a938-472a-9da7-ba6b4478d303 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:49.876581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:49.910778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:49.911715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:49.911999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:49.912277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:49.913054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:49.913337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:49.914830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:49.923446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 160/303] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:49.924243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:49.990474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbf5a8-dbfe-4b41-a575-e5b5529a9828 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.012812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:50.028596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.028803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02c60-df3c-4aec-b8e9-fe376d2c256e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.029393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.029678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.030070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.031393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.032859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.034653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 144/304] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:50.035366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:50.071199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.072361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.072361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.073233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.073731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:50.074041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.075443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.076977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:50.085841 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 161/305] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:50.091064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:50.143333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519261e0-60e9-4844-b7f2-1678327d50ad None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.178932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.179838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.180127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.180406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] PATH_INFO: `/v3/users/f7acddcc1d6e4c2589f99723c80e8c35` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.181615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] RBAC: Authorizing `identity:get_user(user_id=f7acddcc1d6e4c2589f99723c80e8c35)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.183933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.190527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 145/306] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:50 2022] GET /identity/v3/users/f7acddcc1d6e4c2589f99723c80e8c35 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:50.191264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:50.191726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739de74a-98f1-4cf4-8ccf-811f3b046685 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.226096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.226785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.227068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.227338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] PATH_INFO: `/v3/groups` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.228010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.230017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.245322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 162/307] 10.222.0.44 () {60 vars in 1134 bytes} [Thu Jun 30 10:08:50 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:08:50.246450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:50.264518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:50.330061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a62ea3-cbca-443a-95d8-683a9f7be829 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.343118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:50.379463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.380517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.381063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.381463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] PATH_INFO: `/v3/users/db51a5783d294aaab481e2c04c3b6abc` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.389467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941094-55aa-43ec-9ac4-8472899a0273 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.400335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] RBAC: Authorizing `identity:get_user(user_id=db51a5783d294aaab481e2c04c3b6abc)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.402390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.405696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 146/308] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:50 2022] GET /identity/v3/users/db51a5783d294aaab481e2c04c3b6abc => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:50.411315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:50.434960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e3982-98bd-4c56-84c4-d8064f1348dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.436372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3982-98bd-4c56-84c4-d8064f1348dd None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.436867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3982-98bd-4c56-84c4-d8064f1348dd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.437677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3982-98bd-4c56-84c4-d8064f1348dd None admin] PATH_INFO: `/v3/system/users/f7acddcc1d6e4c2589f99723c80e8c35/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.439273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e3982-98bd-4c56-84c4-d8064f1348dd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f7acddcc1d6e4c2589f99723c80e8c35, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.440651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e3982-98bd-4c56-84c4-d8064f1348dd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.454021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 163/309] 10.222.0.44 () {58 vars in 1334 bytes} [Thu Jun 30 10:08:50 2022] PUT /identity/v3/system/users/f7acddcc1d6e4c2589f99723c80e8c35/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:50.455446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa78416-d4ba-44de-8d4e-9fb853208b32 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.455734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa78416-d4ba-44de-8d4e-9fb853208b32 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.456096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa78416-d4ba-44de-8d4e-9fb853208b32 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.457474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 164/310] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:50.463428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7c2f7-8d29-4226-856f-8ee48c465365 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.463833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7c2f7-8d29-4226-856f-8ee48c465365 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.464198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7c2f7-8d29-4226-856f-8ee48c465365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.484583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-79d7c2f7-8d29-4226-856f-8ee48c465365 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:50.486808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-79d7c2f7-8d29-4226-856f-8ee48c465365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:50.563469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ff0e-5fc1-4c1e-b3c1-6f4254922529 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.582930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 165/311] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:50.606360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:50.607597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7c2f7-8d29-4226-856f-8ee48c465365 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:50.614541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.615498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.615979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.616361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.618158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] RBAC: Adding query filter params (role.id=7af225d2412e4fb7bbc4156f193b37d0, user.id=db51a5783d294aaab481e2c04c3b6abc, scope.system=all) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:50.619167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.620777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.629604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 147/312] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 30 10:08:50 2022] GET /identity/v3/role_assignments?user.id=db51a5783d294aaab481e2c04c3b6abc&scope.system=all&role.id=7af225d2412e4fb7bbc4156f193b37d0 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:50.680951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:50.738800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7c2f7-8d29-4226-856f-8ee48c465365 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.776656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.777539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.777822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.778098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.790308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:50.798340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:50.799397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:50.800247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 166/313] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:50.805780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:50.914323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30261c4-2867-4528-96ff-fb3b03c27216 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:50.951428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:50.952181 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:50.952568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:50.952939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:50.953792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:50.954244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:50.955789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:50.965106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 148/314] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:50.970257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:51.075455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2d5be-949d-41bf-bd4d-6cfd493f8a5b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:51.086095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:51.110858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:51.111944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:51.112391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:51.112804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] PATH_INFO: `/v3/users/842c5818f2304851aafd347f7e6cd962` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:51.114125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] RBAC: Authorizing `identity:get_user(user_id=842c5818f2304851aafd347f7e6cd962)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:51.115732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:51.117790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 167/315] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:50 2022] GET /identity/v3/users/842c5818f2304851aafd347f7e6cd962 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:51.123572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:51.168814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:51.232412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d3a50-aba3-493a-9fe5-aac730566bc4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:51.267413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:51.268068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:51.268353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:51.268630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:51.340340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:51.341814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:51.383746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:51.453521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 149/316] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:51.459784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:51.571526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20d078-ea93-46ab-a00c-e0dc070e4e3d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:51.605360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cdb83-528c-42d9-826d-8bbec355f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:51.606206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cdb83-528c-42d9-826d-8bbec355f009 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:51.606489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cdb83-528c-42d9-826d-8bbec355f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:51.606790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cdb83-528c-42d9-826d-8bbec355f009 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:51.607956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cdb83-528c-42d9-826d-8bbec355f009 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:51.609405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cdb83-528c-42d9-826d-8bbec355f009 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:51.611136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 168/317] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:51 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:51.616999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:51.723440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e267-8e1e-457d-bff3-4be0a8415700 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:51.760410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bec3a5-c742-4e0e-adef-7099d0f7135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:51.760994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bec3a5-c742-4e0e-adef-7099d0f7135f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:51.761277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bec3a5-c742-4e0e-adef-7099d0f7135f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:51.761548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bec3a5-c742-4e0e-adef-7099d0f7135f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:51.762381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bec3a5-c742-4e0e-adef-7099d0f7135f None admin] RBAC: Adding query filter params (role.id=7af225d2412e4fb7bbc4156f193b37d0, scope.project.id=c5c026b061f24637b96eff8ca60b86cb, user.id=842c5818f2304851aafd347f7e6cd962) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:51.762720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bec3a5-c742-4e0e-adef-7099d0f7135f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:51.764174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bec3a5-c742-4e0e-adef-7099d0f7135f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:51.770326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 150/318] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:08:51 2022] GET /identity/v3/role_assignments?user.id=842c5818f2304851aafd347f7e6cd962&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=7af225d2412e4fb7bbc4156f193b37d0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:52.363234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2ea6d-8e9c-421a-92b1-511ee182999c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.363609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2ea6d-8e9c-421a-92b1-511ee182999c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.363808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2ea6d-8e9c-421a-92b1-511ee182999c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.365343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 169/319] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:52.370432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d552-8b7c-483f-8c3b-fa4cc24b3b86 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.370750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d552-8b7c-483f-8c3b-fa4cc24b3b86 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.371033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d552-8b7c-483f-8c3b-fa4cc24b3b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.377990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:52.389633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-91a0d552-8b7c-483f-8c3b-fa4cc24b3b86 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:52.390869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-91a0d552-8b7c-483f-8c3b-fa4cc24b3b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:52.468621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 151/320] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:52.491222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2ea6d-8e9c-421a-92b1-511ee182999c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:52.543807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:52.600151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2ea6d-8e9c-421a-92b1-511ee182999c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:52.609566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8e84-85a7-4217-95f1-cec311916600 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.609990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8e84-85a7-4217-95f1-cec311916600 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.610161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8e84-85a7-4217-95f1-cec311916600 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.611670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 152/321] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:52.616338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635568-abec-4f6b-8036-339b96994ecc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.616567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635568-abec-4f6b-8036-339b96994ecc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.616845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635568-abec-4f6b-8036-339b96994ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.633442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-81635568-abec-4f6b-8036-339b96994ecc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:52.634756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-81635568-abec-4f6b-8036-339b96994ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:52.636101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:52.636885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.637167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.637441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.638605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:52.640075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:52.641704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 170/322] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:52.647103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:52.709137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 153/323] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:52.712106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d75f46-d5b9-4894-b034-6a1a9ce02ca4 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.712402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d75f46-d5b9-4894-b034-6a1a9ce02ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.712681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d75f46-d5b9-4894-b034-6a1a9ce02ca4 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.714556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 154/324] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:08:52.719624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922967c3-ab23-4a45-ba3e-85738e7f3ff4 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.719914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922967c3-ab23-4a45-ba3e-85738e7f3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.720226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922967c3-ab23-4a45-ba3e-85738e7f3ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.736546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-922967c3-ab23-4a45-ba3e-85738e7f3ff4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:52.737732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-922967c3-ab23-4a45-ba3e-85738e7f3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:52.755694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6065161-1cd0-4b37-870a-8a3686d5b636 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:52.770390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:52.791504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:52.792164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.792453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.792733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] PATH_INFO: `/v3/groups` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.793423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:52.794886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:52.795904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:52.821295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 171/325] 10.222.0.44 () {60 vars in 1134 bytes} [Thu Jun 30 10:08:52 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:08:52.821295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:52.821585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 155/326] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:52.828986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922967c3-ab23-4a45-ba3e-85738e7f3ff4 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:52.922736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734f19b-cd95-4c52-a41e-607b43a8e544 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:52.946187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922967c3-ab23-4a45-ba3e-85738e7f3ff4 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:52.962436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:52.963318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.963606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.963888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:52.977001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:52.984858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:52.985745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:52.987062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 172/327] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:52.992617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:52.994297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:52.995849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:52.996139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:52.996423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:53.012109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:53.020023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:53.021095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:53.021878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 156/328] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:53.028146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:53.035985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:53.101043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:53.129188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585fa0c-4695-47da-b3cc-2f659ab2b391 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:53.157092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aa108-01f6-4c17-99e6-ceb4e238c30b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:53.179989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:53.180593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:53.180871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:53.181272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:53.182507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:53.183159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:53.184281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:53.199230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 173/329] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:53.205133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:53.208432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:53.209499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:53.209789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:53.210070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:53.210873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:53.211185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:53.212594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:53.221977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 157/330] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:53.227517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:53.315634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:53.323176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62633596-73e0-44fc-84bd-d9441f373c68 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:53.351046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f783e9-2808-4c33-acb3-68546477a55e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:53.364910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:53.365828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:53.366112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:53.366399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] PATH_INFO: `/v3/users/f7acddcc1d6e4c2589f99723c80e8c35` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:53.367641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] RBAC: Authorizing `identity:get_user(user_id=f7acddcc1d6e4c2589f99723c80e8c35)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:53.369068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:53.371846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 174/331] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:53 2022] GET /identity/v3/users/f7acddcc1d6e4c2589f99723c80e8c35 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:53.372491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:53.378918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:53.394741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:53.396220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:53.396651 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:53.397070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] PATH_INFO: `/v3/users/db51a5783d294aaab481e2c04c3b6abc` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:53.398453 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] RBAC: Authorizing `identity:get_user(user_id=db51a5783d294aaab481e2c04c3b6abc)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:53.400105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:53.401937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 158/332] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:53 2022] GET /identity/v3/users/db51a5783d294aaab481e2c04c3b6abc => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:53.408152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:53.516951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790dc5-ef53-43c1-a17b-ca7921992163 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:53.540780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e7b09-4c1f-4d43-b9d8-6031eefba161 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:53.568243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f290dd-b386-4721-9bd8-2d39c1b1ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:53.569295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f290dd-b386-4721-9bd8-2d39c1b1ae9e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:53.570224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f290dd-b386-4721-9bd8-2d39c1b1ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:53.570994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f290dd-b386-4721-9bd8-2d39c1b1ae9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:53.572335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f290dd-b386-4721-9bd8-2d39c1b1ae9e None admin] RBAC: Adding query filter params (role.id=9987e14f9f4744858d584c8867b2a56c, user.id=f7acddcc1d6e4c2589f99723c80e8c35, scope.system=all) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:53.572893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f290dd-b386-4721-9bd8-2d39c1b1ae9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:53.575350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f290dd-b386-4721-9bd8-2d39c1b1ae9e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:53.587174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb93b38-be96-4dda-b831-2fa5b7075496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:53.588863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93b38-be96-4dda-b831-2fa5b7075496 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:53.589374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93b38-be96-4dda-b831-2fa5b7075496 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:53.589863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93b38-be96-4dda-b831-2fa5b7075496 None admin] PATH_INFO: `/v3/system/users/db51a5783d294aaab481e2c04c3b6abc/roles/7af225d2412e4fb7bbc4156f193b37d0` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:53.591469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 175/333] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 30 10:08:53 2022] GET /identity/v3/role_assignments?user.id=f7acddcc1d6e4c2589f99723c80e8c35&scope.system=all&role.id=9987e14f9f4744858d584c8867b2a56c => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:53.591898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb93b38-be96-4dda-b831-2fa5b7075496 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db51a5783d294aaab481e2c04c3b6abc, role_id=7af225d2412e4fb7bbc4156f193b37d0)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:53.593519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb93b38-be96-4dda-b831-2fa5b7075496 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:53.606882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 159/334] 10.222.0.44 () {58 vars in 1334 bytes} [Thu Jun 30 10:08:53 2022] PUT /identity/v3/system/users/db51a5783d294aaab481e2c04c3b6abc/roles/7af225d2412e4fb7bbc4156f193b37d0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:08:55.127121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6cb5-9d31-4002-ac65-61560682797f None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:55.128089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6cb5-9d31-4002-ac65-61560682797f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:55.128607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d6cb5-9d31-4002-ac65-61560682797f None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:55.130523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 176/335] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:55.137259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6695fd-23a3-4c6f-b229-20ca40564b43 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:55.138115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6695fd-23a3-4c6f-b229-20ca40564b43 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:55.138644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6695fd-23a3-4c6f-b229-20ca40564b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:55.161243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3b6695fd-23a3-4c6f-b229-20ca40564b43 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:55.162828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3b6695fd-23a3-4c6f-b229-20ca40564b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:55.216691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:55.252345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 160/336] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:55.296331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d6cb5-9d31-4002-ac65-61560682797f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:55.325805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:55.416924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d6cb5-9d31-4002-ac65-61560682797f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:55.458668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9701c-1291-4060-b6ac-fd8e4efd08ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:55.459584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9701c-1291-4060-b6ac-fd8e4efd08ca None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:55.460076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9701c-1291-4060-b6ac-fd8e4efd08ca None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:55.460583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9701c-1291-4060-b6ac-fd8e4efd08ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:55.480946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9701c-1291-4060-b6ac-fd8e4efd08ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-eae9701c-1291-4060-b6ac-fd8e4efd08ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:55.489229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:55.490085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:55.491268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:55.493814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 177/337] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:55.500215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6695fd-23a3-4c6f-b229-20ca40564b43 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:55.592475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2e21-91a4-4cd8-80e5-21dbb057e174 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:55.592824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2e21-91a4-4cd8-80e5-21dbb057e174 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:55.593039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a2e21-91a4-4cd8-80e5-21dbb057e174 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:55.594672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 178/338] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:55.612161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025edf6e-b9f6-47da-aecc-ad44d371edcb None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:55.612451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025edf6e-b9f6-47da-aecc-ad44d371edcb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:55.612737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025edf6e-b9f6-47da-aecc-ad44d371edcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:55.644787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6695fd-23a3-4c6f-b229-20ca40564b43 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:55.659249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-025edf6e-b9f6-47da-aecc-ad44d371edcb None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:55.660483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-025edf6e-b9f6-47da-aecc-ad44d371edcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:55.702481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:55.703105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:55.703384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:55.703655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:55.704404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:55.704707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:55.706090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:55.722389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 161/339] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:55.727530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:55.793419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 179/340] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:08:55.803538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:55.846275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025edf6e-b9f6-47da-aecc-ad44d371edcb None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:55.879037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:55.896736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec14d7-692b-4949-b0c0-07922a1de64f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:55.966624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f74c4-1540-4831-ac1f-a447aa5278eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:55.967647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f74c4-1540-4831-ac1f-a447aa5278eb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:55.969105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f74c4-1540-4831-ac1f-a447aa5278eb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:55.969708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f74c4-1540-4831-ac1f-a447aa5278eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.064749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025edf6e-b9f6-47da-aecc-ad44d371edcb None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:56.073698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f74c4-1540-4831-ac1f-a447aa5278eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:56.075601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f74c4-1540-4831-ac1f-a447aa5278eb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:56.123886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bce2f-b95c-4ece-b385-4a61fc515ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:56.125306 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bce2f-b95c-4ece-b385-4a61fc515ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.125654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bce2f-b95c-4ece-b385-4a61fc515ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.125935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bce2f-b95c-4ece-b385-4a61fc515ee7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.126769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:56.152198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bce2f-b95c-4ece-b385-4a61fc515ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c61bce2f-b95c-4ece-b385-4a61fc515ee7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:56.164522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:56.165422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:56.167237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 180/341] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:08:56.168082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20266-636e-4311-921b-f52c482e0302 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.168200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20266-636e-4311-921b-f52c482e0302 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.168647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20266-636e-4311-921b-f52c482e0302 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.170322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 181/342] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:56.175800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20266-636e-4311-921b-f52c482e0302 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:56.196779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 162/343] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:56.199518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b545d9-adb2-4746-87c9-f1c917d100bb None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.200017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b545d9-adb2-4746-87c9-f1c917d100bb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.200533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b545d9-adb2-4746-87c9-f1c917d100bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.219684 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-06b545d9-adb2-4746-87c9-f1c917d100bb None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:56.221283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-06b545d9-adb2-4746-87c9-f1c917d100bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:56.293757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:56.335805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 163/344] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:56.339070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b545d9-adb2-4746-87c9-f1c917d100bb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:56.352389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20266-636e-4311-921b-f52c482e0302 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:56.403768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:56.404710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.405140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.405596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.406492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:56.406990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:56.408703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:56.418258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 182/345] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:56.419331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:56.470766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:56.523058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b545d9-adb2-4746-87c9-f1c917d100bb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:56.544225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37026afc-4fc5-4637-a2ab-a76af370c57b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:56.582132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:56.583281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.583839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.584258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.591011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:56.603367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:56.612323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:56.613265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:08:56.614147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:56.616513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 183/346] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:56.617497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:56.619328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:56.621034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.621317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.621590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.622922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:56.624397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:56.635768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 164/347] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:56 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:56.636596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:56.743207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d331ba7-98b8-4a71-a0d8-3f8584cb608f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:56.785613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e9794-f979-45db-b76f-c3e3757f3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:56.786791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9794-f979-45db-b76f-c3e3757f3fed None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.787542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9794-f979-45db-b76f-c3e3757f3fed None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.788249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9794-f979-45db-b76f-c3e3757f3fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.831217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f904-5984-4715-9d78-356576d9bf25 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:56.871686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:56.876222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:56.877173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:56.877658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:56.878136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:56.879369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:56.879909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:56.882270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:56.882433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e9794-f979-45db-b76f-c3e3757f3fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:56.884165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e9794-f979-45db-b76f-c3e3757f3fed None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:56.890081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:56.893517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 165/348] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:56.894533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.007207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 184/349] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:57.008874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425db23-ff3d-447d-9497-e531d7046619 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.009233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425db23-ff3d-447d-9497-e531d7046619 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.009586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425db23-ff3d-447d-9497-e531d7046619 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.015225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 185/350] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:57.016130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425db23-ff3d-447d-9497-e531d7046619 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.027582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203c358-a277-48ff-92a2-95ca61221cfb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.073437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:57.074951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.075417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.075888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.086897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:57.090067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:57.093652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 166/351] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:08:56 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:57.095347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.138792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:57.148670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425db23-ff3d-447d-9497-e531d7046619 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.183326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:57.194760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ef45b-f805-4306-9fe6-91918763f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:57.195773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ef45b-f805-4306-9fe6-91918763f501 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.196138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ef45b-f805-4306-9fe6-91918763f501 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.196545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ef45b-f805-4306-9fe6-91918763f501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.232890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec805a2-b6ae-4816-9dad-5b43deea1982 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.280540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3f581-fbf9-4069-802e-27a1aacdb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:57.281393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f581-fbf9-4069-802e-27a1aacdb00a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.282414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f581-fbf9-4069-802e-27a1aacdb00a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.282414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3f581-fbf9-4069-802e-27a1aacdb00a None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.283842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f581-fbf9-4069-802e-27a1aacdb00a None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:57.284615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ef45b-f805-4306-9fe6-91918763f501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:57.284747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3f581-fbf9-4069-802e-27a1aacdb00a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:57.286068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ef45b-f805-4306-9fe6-91918763f501 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:57.288053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 167/352] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:57.288053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ee25-4c29-40a2-9fde-980339da8100 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.288335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ee25-4c29-40a2-9fde-980339da8100 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.288671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6ee25-4c29-40a2-9fde-980339da8100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.306224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-95c6ee25-4c29-40a2-9fde-980339da8100 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:57.308028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-95c6ee25-4c29-40a2-9fde-980339da8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:57.396765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 168/353] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:57.399141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ee25-4c29-40a2-9fde-980339da8100 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.419776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:57.434843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 186/354] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:57.436279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8bd1-456c-4c74-9d64-21ee15f87fe6 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.436616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8bd1-456c-4c74-9d64-21ee15f87fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.436895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8bd1-456c-4c74-9d64-21ee15f87fe6 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.438377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 187/355] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:57.438940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8bd1-456c-4c74-9d64-21ee15f87fe6 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.481790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:57.523041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6ee25-4c29-40a2-9fde-980339da8100 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.564475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8bd1-456c-4c74-9d64-21ee15f87fe6 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.567153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:57.567815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.568092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.568362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.569186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=6f127d6bcfe64a2694256fed07561a95) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:57.569494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:57.571297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:57.579542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 169/356] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=9987e14f9f4744858d584c8867b2a56c => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:57.580243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.621083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:57.621998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.622280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.622565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.627898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:57.630934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:57.631991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 188/357] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:57.632866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.712542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:57.728895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c7275-d181-45d6-bd1a-9671a1601bbd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.759663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8108ce2-25c6-43c2-bd72-bb62ac5f83df None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.768703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:57.779096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11819c47-d4a1-4a5f-ae91-0183ac9c31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:57.779890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819c47-d4a1-4a5f-ae91-0183ac9c31f1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.781091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819c47-d4a1-4a5f-ae91-0183ac9c31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.781373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11819c47-d4a1-4a5f-ae91-0183ac9c31f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.795819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11819c47-d4a1-4a5f-ae91-0183ac9c31f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-11819c47-d4a1-4a5f-ae91-0183ac9c31f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:57.803749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:57.804640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:57.805401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 170/358] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:57.811474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b55be-c180-436e-9e9f-19f01a371bf7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.811474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b55be-c180-436e-9e9f-19f01a371bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.811474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b55be-c180-436e-9e9f-19f01a371bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.815657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:57.816607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.816980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.817319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.818591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:57.820080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:57.822243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 189/359] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:57.823988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.837334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-411b55be-c180-436e-9e9f-19f01a371bf7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:57.839142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-411b55be-c180-436e-9e9f-19f01a371bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:57.921286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 171/360] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:57.928131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478050d2-8cb5-4fb1-bd29-452b7f615baf None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:57.928428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478050d2-8cb5-4fb1-bd29-452b7f615baf None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:57.928711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478050d2-8cb5-4fb1-bd29-452b7f615baf None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:57.930195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 172/361] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:08:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:08:57.931892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478050d2-8cb5-4fb1-bd29-452b7f615baf None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:57.957702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe00cf3-21d2-4401-aa27-ec0da5bfcdc0 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:57.993029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:58.001031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.001280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.001652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.002318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.004557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=6f127d6bcfe64a2694256fed07561a95) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:58.004557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:58.006488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:58.013512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 190/362] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:58.014315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.098603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478050d2-8cb5-4fb1-bd29-452b7f615baf None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.124128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:58.158034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3119f-cbe6-4ba1-b808-b29307bc5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.159885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3119f-cbe6-4ba1-b808-b29307bc5756 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.160365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3119f-cbe6-4ba1-b808-b29307bc5756 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.160897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3119f-cbe6-4ba1-b808-b29307bc5756 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.161907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3119f-cbe6-4ba1-b808-b29307bc5756 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:58.162045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de073b2-3b32-4d4b-a961-efe4bdb4736d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.162532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3119f-cbe6-4ba1-b808-b29307bc5756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:58.164552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3119f-cbe6-4ba1-b808-b29307bc5756 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:58.177055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 173/363] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:08:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:58.179622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2306-9f52-4488-a141-d3ee1e60d411 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.180124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2306-9f52-4488-a141-d3ee1e60d411 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.180580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2306-9f52-4488-a141-d3ee1e60d411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.202642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-70bb2306-9f52-4488-a141-d3ee1e60d411 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:08:58.204755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-70bb2306-9f52-4488-a141-d3ee1e60d411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:08:58.210968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.211951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.212351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.212735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.214105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:58.216313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:58.221583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 191/364] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:58.221583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.301513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 174/365] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:08:58.303465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb2306-9f52-4488-a141-d3ee1e60d411 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.307613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:58.336453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa77b-592c-49da-81a3-89aecfcdd72c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.379108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.379992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.380378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.380750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.393951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:58.402244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:58.403183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:08:58.404111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 192/366] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:58.404825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.437020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb2306-9f52-4488-a141-d3ee1e60d411 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.448621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:58.483177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.489803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.490301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.490810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] PATH_INFO: `/v3/users/db51a5783d294aaab481e2c04c3b6abc` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.493450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] RBAC: Authorizing `identity:get_user(user_id=db51a5783d294aaab481e2c04c3b6abc)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:58.495843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:58.498111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 175/367] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/users/db51a5783d294aaab481e2c04c3b6abc => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:58.499293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.520573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b00d8-099c-4643-93f4-ebcd193e656c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.549010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:58.563790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.564766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.565274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.565762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.566819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=c5c026b061f24637b96eff8ca60b86cb) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:58.567333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:58.568955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:58.575136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 193/368] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=9987e14f9f4744858d584c8867b2a56c => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:58.576843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.643612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648142bc-7d35-4acc-9272-9ce443ebea71 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.702424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.703266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.703544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.703818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.719417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:08:58.731585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:08:58.732554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:08:58.733333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 176/369] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:08:58.734572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.781869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2e39e-cf8c-4cb7-ba5d-16a820dd40f1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.807631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:58.843320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.844013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.844289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.844605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.845470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:58.845869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:58.847311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:58.860278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 194/370] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:58.861137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.894636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03f74-abe0-4027-8da7-5fcdace86c71 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:58.916038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:58.935518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:58.936290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:58.936576 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:58.936850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:58.937691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] RBAC: Adding query filter params (role.id=7af225d2412e4fb7bbc4156f193b37d0, user.id=db51a5783d294aaab481e2c04c3b6abc, scope.system=all) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:58.938004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:58.939609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:58.953496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 177/371] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/role_assignments?user.id=db51a5783d294aaab481e2c04c3b6abc&scope.system=all&role.id=7af225d2412e4fb7bbc4156f193b37d0 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:58.954344 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:58.983971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613092e3-636b-4627-845e-5e3047e76af9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:59.037370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:59.038046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:59.038329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:59.038602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:59.039504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:08:59.039816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:59.041219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:59.051849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 195/372] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:59.057041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:59.062003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:59.069305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b7653-dad8-4ad7-8a8c-51d82b8cae34 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:59.110721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:59.111420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:59.111812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:59.112095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:59.176901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc2625-2572-46da-9f6b-b228f3337579 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:59.190464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:59.192594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:59.194319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:59.218193 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:59.222433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:59.222773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:59.223057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:59.301316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:59.302875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:59.306661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:59.315925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 178/373] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:08:59.324212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:59.414710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 196/374] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:08:59.416721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:59.432585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:59.490241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69288b7e-d21e-4340-9d22-117fd43700f3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:59.556962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404db871-7acf-41dc-a1d1-8fcd34a6582b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:59.561297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:59.562154 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:59.562439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:59.562727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:59.568531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:59.570012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:59.572063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 179/375] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:59 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:08:59.578050 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:59.630638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:59.631519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:59.631800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:59.632075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] PATH_INFO: `/v3/projects/9982519b09d14f298a1a1f477137a258` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:59.633640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] RBAC: Authorizing `identity:get_project(project_id=9982519b09d14f298a1a1f477137a258)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:59.635961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:59.638145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 197/376] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:08:59 2022] GET /identity/v3/projects/9982519b09d14f298a1a1f477137a258 => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:59.644900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:59.696313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:59.758703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df2f1b-1678-4870-ba4d-66a3c4468441 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:59.768258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:08:59.801261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f5683-f2cd-4b43-b359-aec403d5d108 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:08:59.801702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:59.802824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:59.803107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:59.803625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:59.804834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:59.806283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:59.808523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 180/377] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:08:59 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:59.816094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:59.875035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:08:59.875889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:08:59.876164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:08:59.876432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] PATH_INFO: `/v3/groups/782b4a276de140568c71d535293227af` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:08:59.890611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] RBAC: Authorizing `identity:get_group(group_id=782b4a276de140568c71d535293227af)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:08:59.892206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:08:59.893980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 198/378] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:08:59 2022] GET /identity/v3/groups/782b4a276de140568c71d535293227af => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:08:59.899761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:08:59.992547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95014609-04cb-4980-9e18-f764aa03b046 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:00.051042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:00.062488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd0c6a-2e88-4674-af64-37e940c96a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:00.063226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0c6a-2e88-4674-af64-37e940c96a0d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.063506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0c6a-2e88-4674-af64-37e940c96a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.063775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd0c6a-2e88-4674-af64-37e940c96a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.064606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0c6a-2e88-4674-af64-37e940c96a0d None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=c5c026b061f24637b96eff8ca60b86cb) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:00.064913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0c6a-2e88-4674-af64-37e940c96a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:00.065524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1fed6-1623-48bd-bfcb-d8437801de2f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:00.066358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd0c6a-2e88-4674-af64-37e940c96a0d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:00.077741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 181/379] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:08:59 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:00.107110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee238-e88f-472c-be17-bc8af2d2a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:00.107780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee238-e88f-472c-be17-bc8af2d2a06f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.108064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee238-e88f-472c-be17-bc8af2d2a06f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.108349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee238-e88f-472c-be17-bc8af2d2a06f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.109185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee238-e88f-472c-be17-bc8af2d2a06f None admin] RBAC: Adding query filter params (group.id=782b4a276de140568c71d535293227af, role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=9982519b09d14f298a1a1f477137a258) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:00.109499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee238-e88f-472c-be17-bc8af2d2a06f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:00.110972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee238-e88f-472c-be17-bc8af2d2a06f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:00.118654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 199/380] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:08:59 2022] GET /identity/v3/role_assignments?group.id=782b4a276de140568c71d535293227af&scope.project.id=9982519b09d14f298a1a1f477137a258&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:00.306417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526f96-de85-4139-89e7-884bfcdb3b9b None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.306417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526f96-de85-4139-89e7-884bfcdb3b9b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.306417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df526f96-de85-4139-89e7-884bfcdb3b9b None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.306417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 182/381] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:00.314242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b002e-9ebf-40ef-b4f0-c0f15aacd42b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.314771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b002e-9ebf-40ef-b4f0-c0f15aacd42b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.314848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b002e-9ebf-40ef-b4f0-c0f15aacd42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.327881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:00.334017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-cf2b002e-9ebf-40ef-b4f0-c0f15aacd42b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:00.335613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cf2b002e-9ebf-40ef-b4f0-c0f15aacd42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:00.422717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 200/382] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:00.449939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526f96-de85-4139-89e7-884bfcdb3b9b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:00.565517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df526f96-de85-4139-89e7-884bfcdb3b9b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:00.602678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4a2aa-0bd4-480c-8432-c2a83c714596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:00.603498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a2aa-0bd4-480c-8432-c2a83c714596 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.603838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a2aa-0bd4-480c-8432-c2a83c714596 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.604614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a2aa-0bd4-480c-8432-c2a83c714596 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.615155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a2aa-0bd4-480c-8432-c2a83c714596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-cdd4a2aa-0bd4-480c-8432-c2a83c714596 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:00.629826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:00.631641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:00.633284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 183/383] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:00.638038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b002e-9ebf-40ef-b4f0-c0f15aacd42b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:00.783940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b002e-9ebf-40ef-b4f0-c0f15aacd42b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:00.824327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702e30-2a57-4f1b-a99b-1112dac54929 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.824620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702e30-2a57-4f1b-a99b-1112dac54929 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.825012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702e30-2a57-4f1b-a99b-1112dac54929 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.825465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:00.826134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.826415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.826708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.827470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:00.827775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:00.828331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 184/384] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:00.829157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:00.834730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06393346-0f92-4e1a-ac54-bc245df8dcec None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:00.834730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06393346-0f92-4e1a-ac54-bc245df8dcec None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:00.834730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06393346-0f92-4e1a-ac54-bc245df8dcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:00.840282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:00.852188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 201/385] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:09:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:00.852875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:00.865903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-06393346-0f92-4e1a-ac54-bc245df8dcec None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:00.867132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-06393346-0f92-4e1a-ac54-bc245df8dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:00.966667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:01.005024 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 185/386] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:01.028396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cae71-0be3-4815-aea9-d382a303f38c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.051287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06393346-0f92-4e1a-ac54-bc245df8dcec None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.089522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.090301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.090579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.090876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.095301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:01.096908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:01.098839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 202/387] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:00 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:01.104763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.179358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06393346-0f92-4e1a-ac54-bc245df8dcec None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.213527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:01.223008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.224741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.225021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.225469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.240173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:01.250068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:01.250984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:01.252331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 186/388] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:01.258275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.278810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd9f45-8d12-46e1-9edf-70ae162a7e47 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.319078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.319933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.320211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.320481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.322626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:01.324534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:01.326556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 203/389] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:01 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:01.345480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:01.355988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.419525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3f377-4ab3-4eae-991e-dd1cbca40477 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.455373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf4de4-99d1-4ac7-9e23-2f4e5226278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.456048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4de4-99d1-4ac7-9e23-2f4e5226278a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.456336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4de4-99d1-4ac7-9e23-2f4e5226278a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.456634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4de4-99d1-4ac7-9e23-2f4e5226278a None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.457356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4de4-99d1-4ac7-9e23-2f4e5226278a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:01.457666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4de4-99d1-4ac7-9e23-2f4e5226278a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:01.459190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4de4-99d1-4ac7-9e23-2f4e5226278a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:01.468475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 187/390] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:01.469957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c837d-f80f-466f-a62e-7be5fe4f1471 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.470242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c837d-f80f-466f-a62e-7be5fe4f1471 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.470558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c837d-f80f-466f-a62e-7be5fe4f1471 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.471880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 188/391] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:01.475669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a45f89-4068-4117-8a54-12cc939f2b64 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.476775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c837d-f80f-466f-a62e-7be5fe4f1471 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.525436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668a42-dade-4f29-9fd3-59dcb6575435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.526765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668a42-dade-4f29-9fd3-59dcb6575435 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.527197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668a42-dade-4f29-9fd3-59dcb6575435 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.527604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668a42-dade-4f29-9fd3-59dcb6575435 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95/groups/5c8702cf680646b591d2118ad5bfc650/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.531829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668a42-dade-4f29-9fd3-59dcb6575435 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f127d6bcfe64a2694256fed07561a95, group_id=5c8702cf680646b591d2118ad5bfc650, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:01.533278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09668a42-dade-4f29-9fd3-59dcb6575435 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:01.535698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:01.559035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 204/392] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 30 10:09:01 2022] PUT /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95/groups/5c8702cf680646b591d2118ad5bfc650/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:01.561280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e459-3998-4d69-a2d9-60688d90a44e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.561867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e459-3998-4d69-a2d9-60688d90a44e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.562395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e459-3998-4d69-a2d9-60688d90a44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.584099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-63f9e459-3998-4d69-a2d9-60688d90a44e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:01.585844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-63f9e459-3998-4d69-a2d9-60688d90a44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:01.595819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c837d-f80f-466f-a62e-7be5fe4f1471 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.603770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:01.638992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.639871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.640149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.640431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.643696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:01.645222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:01.647425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 189/393] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:01 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:01.654455 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.681737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 205/394] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:01.715690 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e459-3998-4d69-a2d9-60688d90a44e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.804256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173d0c-5739-49ae-934c-86c2d717da04 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.864331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326213bd-484a-472c-8159-070554593895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.865442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326213bd-484a-472c-8159-070554593895 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.865824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326213bd-484a-472c-8159-070554593895 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.866510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326213bd-484a-472c-8159-070554593895 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.868035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326213bd-484a-472c-8159-070554593895 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:01.870040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e459-3998-4d69-a2d9-60688d90a44e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:01.872700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326213bd-484a-472c-8159-070554593895 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:01.875199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 190/395] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:01 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:01.885125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326213bd-484a-472c-8159-070554593895 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:01.903632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:01.917536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:01.919034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:01.919418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:01.919727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:01.931378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:01.940581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:01.941490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:01.942305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 206/396] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:01.945939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:01.949441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:02.014419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326213bd-484a-472c-8159-070554593895 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:02.052445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:02.053694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:02.054183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:02.054661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95/groups/5c8702cf680646b591d2118ad5bfc650/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:02.054885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb536a1b-3d30-4704-aa79-4826cd242987 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:02.058255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] RBAC: Authorizing `identity:create_grant(project_id=6f127d6bcfe64a2694256fed07561a95, group_id=5c8702cf680646b591d2118ad5bfc650, role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:02.060011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:02.084424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 191/397] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 30 10:09:01 2022] PUT /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95/groups/5c8702cf680646b591d2118ad5bfc650/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:02.097855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:02.098591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:02.098922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:02.099254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:02.100016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:02.100325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:02.101783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:02.111990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 207/398] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:09:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:02.117774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:02.252956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbaa8d-a772-4772-bb9f-c84399e27f6b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:02.254604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:02.295564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:02.296438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:02.296721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:02.296996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:02.298216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:02.299729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:02.301699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 192/399] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:02 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:02.308078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:02.358904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:02.414276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b017-d3a3-4c96-bfa9-aa2ee4c03e78 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:02.450848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50672ee7-9aa9-4d68-9ef4-d7cf4401a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:02.451721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672ee7-9aa9-4d68-9ef4-d7cf4401a43a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:02.452004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672ee7-9aa9-4d68-9ef4-d7cf4401a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:02.452341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50672ee7-9aa9-4d68-9ef4-d7cf4401a43a None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:02.453591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672ee7-9aa9-4d68-9ef4-d7cf4401a43a None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:02.455066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50672ee7-9aa9-4d68-9ef4-d7cf4401a43a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:02.457083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 208/400] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:02 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:02.462868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:02.578909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4c721-26ee-44c2-858f-76a16ab0a168 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:02.622338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649d7c-2fe9-4156-acc0-653e9f1bba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:02.623261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649d7c-2fe9-4156-acc0-653e9f1bba4c None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:02.623541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649d7c-2fe9-4156-acc0-653e9f1bba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:02.623822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649d7c-2fe9-4156-acc0-653e9f1bba4c None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb/groups/5c8702cf680646b591d2118ad5bfc650/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:02.625805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91649d7c-2fe9-4156-acc0-653e9f1bba4c None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c026b061f24637b96eff8ca60b86cb, group_id=5c8702cf680646b591d2118ad5bfc650, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:02.632927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91649d7c-2fe9-4156-acc0-653e9f1bba4c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:02.660994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 193/401] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 30 10:09:02 2022] PUT /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb/groups/5c8702cf680646b591d2118ad5bfc650/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:02.873102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9037c3-0083-4bcd-961e-52572d0fdf2d None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:02.873446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9037c3-0083-4bcd-961e-52572d0fdf2d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:02.873621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9037c3-0083-4bcd-961e-52572d0fdf2d None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:02.875320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 209/402] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:02.881079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02bf1d-1e3d-4758-aaa6-b2aa130df95c None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:02.881372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02bf1d-1e3d-4758-aaa6-b2aa130df95c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:02.881653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02bf1d-1e3d-4758-aaa6-b2aa130df95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:02.904574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6a02bf1d-1e3d-4758-aaa6-b2aa130df95c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:02.905802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6a02bf1d-1e3d-4758-aaa6-b2aa130df95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:02.936961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:02.989871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 194/403] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:03.016477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9037c3-0083-4bcd-961e-52572d0fdf2d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:03.154434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9037c3-0083-4bcd-961e-52572d0fdf2d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:03.169362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:03.193172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661effd6-04f6-408e-872b-67dfedd40ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:03.193983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661effd6-04f6-408e-872b-67dfedd40ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.194270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661effd6-04f6-408e-872b-67dfedd40ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.194550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661effd6-04f6-408e-872b-67dfedd40ac9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.205637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661effd6-04f6-408e-872b-67dfedd40ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-661effd6-04f6-408e-872b-67dfedd40ac9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:03.213833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:03.214775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:03.215590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:03.218790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 210/404] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:03.222744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02bf1d-1e3d-4758-aaa6-b2aa130df95c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:03.253307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0cea1-8ec2-41fe-aa50-db95a5b249de None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.253629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0cea1-8ec2-41fe-aa50-db95a5b249de None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.253867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0cea1-8ec2-41fe-aa50-db95a5b249de None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.258707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 211/405] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:03.260794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dfca6-3326-4e30-82a4-241b829ce8ce None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.261080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dfca6-3326-4e30-82a4-241b829ce8ce None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.261362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dfca6-3326-4e30-82a4-241b829ce8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.300891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e52dfca6-3326-4e30-82a4-241b829ce8ce None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:03.302507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e52dfca6-3326-4e30-82a4-241b829ce8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:03.405483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02bf1d-1e3d-4758-aaa6-b2aa130df95c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:03.444153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 212/406] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:03.468779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:03.469258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dfca6-3326-4e30-82a4-241b829ce8ce None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:03.469492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.469737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.470008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.470922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:03.471231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:03.472626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:03.487057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 195/407] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:03.488612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:03.524180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:03.628445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dfca6-3326-4e30-82a4-241b829ce8ce None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:03.635811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:03.660259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1f85-501f-4fc5-b5ff-9467beb26a2a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:03.699974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:03.701587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.701868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.702142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.719465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:03.730306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:03.731190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.731469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.731741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.732930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:03.734379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:03.736088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 196/408] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:03 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:03.736513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:03.737397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:03.738182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 213/409] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:03.741565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:03.745858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:03.904525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:03.920647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750e7a4-8d9d-497b-99e3-921b70e008bd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:03.923215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6238d-92b7-48be-8d73-5bf7de4c9729 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:03.980991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:03.981854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.982139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.982416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.984146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:03.984691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:03.985348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:03.985626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:03.986978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:03.988858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 197/410] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:03 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:03.988977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:03.989703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:03.990019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:03.991456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:03.995242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:04.008952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 214/411] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:04.015169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:04.065668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:04.164689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d4222-9b62-45f8-b845-f011357f3c02 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:04.210868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edc695-8709-455e-80aa-b7a13f2194a0 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:04.237202 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:04.238088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.238367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.238640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb/groups/5c8702cf680646b591d2118ad5bfc650/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.242426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c026b061f24637b96eff8ca60b86cb, group_id=5c8702cf680646b591d2118ad5bfc650, role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:04.243896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:04.270577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 198/412] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 30 10:09:03 2022] PUT /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb/groups/5c8702cf680646b591d2118ad5bfc650/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:04.274485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354249f6-927c-4008-9e62-0cdb15335208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:04.275448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354249f6-927c-4008-9e62-0cdb15335208 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.276327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354249f6-927c-4008-9e62-0cdb15335208 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.276603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354249f6-927c-4008-9e62-0cdb15335208 None admin] PATH_INFO: `/v3/groups/782b4a276de140568c71d535293227af` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.277971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354249f6-927c-4008-9e62-0cdb15335208 None admin] RBAC: Authorizing `identity:get_group(group_id=782b4a276de140568c71d535293227af)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:04.279482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354249f6-927c-4008-9e62-0cdb15335208 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:04.281528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 215/413] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:04 2022] GET /identity/v3/groups/782b4a276de140568c71d535293227af => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:04.287301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:04.309308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:04.415666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccef20-559b-492e-af51-b85acb4233ec None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:04.447081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6e71f-f9af-4e3b-8a06-bcc0c33697a2 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.447649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6e71f-f9af-4e3b-8a06-bcc0c33697a2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.448251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6e71f-f9af-4e3b-8a06-bcc0c33697a2 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.449904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 216/414] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:04.455760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0a0fe-cf7b-43cb-ab49-981b9d5be6c9 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.456052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0a0fe-cf7b-43cb-ab49-981b9d5be6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.456334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0a0fe-cf7b-43cb-ab49-981b9d5be6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.477929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c0b0a0fe-cf7b-43cb-ab49-981b9d5be6c9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:04.483882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c0b0a0fe-cf7b-43cb-ab49-981b9d5be6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:04.488169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:04.489120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.489401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.489716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] PATH_INFO: `/v3/projects/9982519b09d14f298a1a1f477137a258` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.495033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] RBAC: Authorizing `identity:get_project(project_id=9982519b09d14f298a1a1f477137a258)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:04.496402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:04.500070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 199/415] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:04 2022] GET /identity/v3/projects/9982519b09d14f298a1a1f477137a258 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:04.505815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:04.597466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 217/416] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:04.625162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:04.628251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0a0fe-cf7b-43cb-ab49-981b9d5be6c9 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:04.644778 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4b3a1-f3ab-475e-ae09-ec8395013c3c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:04.656742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:04.698194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56148302-e5c9-4c67-9d29-98dcd8db4d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:04.700040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56148302-e5c9-4c67-9d29-98dcd8db4d92 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.700601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56148302-e5c9-4c67-9d29-98dcd8db4d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.701018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56148302-e5c9-4c67-9d29-98dcd8db4d92 None admin] PATH_INFO: `/v3/projects/9982519b09d14f298a1a1f477137a258/groups/782b4a276de140568c71d535293227af/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.704070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56148302-e5c9-4c67-9d29-98dcd8db4d92 None admin] RBAC: Authorizing `identity:create_grant(project_id=9982519b09d14f298a1a1f477137a258, group_id=782b4a276de140568c71d535293227af, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:04.706560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56148302-e5c9-4c67-9d29-98dcd8db4d92 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:04.723709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 200/417] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 30 10:09:04 2022] PUT /identity/v3/projects/9982519b09d14f298a1a1f477137a258/groups/782b4a276de140568c71d535293227af/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:04.727519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415d6ce-d9b8-4c56-922d-6aeb71f09bc4 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.728070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415d6ce-d9b8-4c56-922d-6aeb71f09bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.728494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415d6ce-d9b8-4c56-922d-6aeb71f09bc4 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.730762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 201/418] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:04.737836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1a2a5-8ba7-45a8-bd32-d314df285a67 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.740430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1a2a5-8ba7-45a8-bd32-d314df285a67 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.741785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1a2a5-8ba7-45a8-bd32-d314df285a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.778722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0a0fe-cf7b-43cb-ab49-981b9d5be6c9 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:04.780302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-37a1a2a5-8ba7-45a8-bd32-d314df285a67 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:04.782473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-37a1a2a5-8ba7-45a8-bd32-d314df285a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:04.846458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:04.848350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:04.849328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:04.849939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:04.865981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:04.875969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:04.877102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:04.877982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:04.880311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 218/419] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:04.888448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:04.928350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 202/420] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:04.958117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1a2a5-8ba7-45a8-bd32-d314df285a67 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.045541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:05.053999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edb77f-6adc-45e9-869c-5cfbd1cab5f8 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:05.069519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:05.095698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:05.096924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.097808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.098303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.099320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] RBAC: Adding query filter params (name=member) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:05.099843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:05.101414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:05.113318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 219/421] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:09:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:05.124094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.130146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1a2a5-8ba7-45a8-bd32-d314df285a67 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:05.170254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:05.171126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.171414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.171692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.192975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:05.208516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:05.209891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:05.210721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 203/422] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:05.219000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.340068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf03cf3-204b-45a4-9c67-74eb8ddc0486 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:05.376619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a0b6b-b756-4ca5-8201-a8592d2fe99f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:05.402655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3ec4f-815b-46d9-8fef-23130761c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:05.403726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3ec4f-815b-46d9-8fef-23130761c855 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.404314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3ec4f-815b-46d9-8fef-23130761c855 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.404779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3ec4f-815b-46d9-8fef-23130761c855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.412046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec385a1-e942-4796-b9fe-519e2754f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:05.412716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec385a1-e942-4796-b9fe-519e2754f372 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.412999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec385a1-e942-4796-b9fe-519e2754f372 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.413289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec385a1-e942-4796-b9fe-519e2754f372 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.414032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec385a1-e942-4796-b9fe-519e2754f372 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:05.414336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec385a1-e942-4796-b9fe-519e2754f372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:05.416347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec385a1-e942-4796-b9fe-519e2754f372 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:05.418615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:05.424267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:05.430769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 204/423] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:05.430769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b20f-ff1c-49ea-a1f1-b02b9959256b None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.430769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b20f-ff1c-49ea-a1f1-b02b9959256b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.430769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04b20f-ff1c-49ea-a1f1-b02b9959256b None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.430769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 205/424] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:05.432068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b20f-ff1c-49ea-a1f1-b02b9959256b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.509463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3ec4f-815b-46d9-8fef-23130761c855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:05.512737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3ec4f-815b-46d9-8fef-23130761c855 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:05.545766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04b20f-ff1c-49ea-a1f1-b02b9959256b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:05.583962 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:05.584622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.584907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.585182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.653344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 220/425] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:05.654985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be508-3023-4aab-8433-c1ab08ac2f4a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.655466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be508-3023-4aab-8433-c1ab08ac2f4a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.655931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be508-3023-4aab-8433-c1ab08ac2f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.659898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:05.664795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:05.666419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:05.675820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-682be508-3023-4aab-8433-c1ab08ac2f4a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:05.677246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-682be508-3023-4aab-8433-c1ab08ac2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:05.736054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:05.776379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 221/426] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:05.776379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682be508-3023-4aab-8433-c1ab08ac2f4a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.782885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 206/427] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:05.788368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.889492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682be508-3023-4aab-8433-c1ab08ac2f4a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:05.895130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:05.899523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c729f-ac33-4df8-8e70-d18e5db45a4f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:05.926991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:05.927880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.928169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.928449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.929818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:05.931412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:05.937769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 222/428] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:05 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:05.938712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.940551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:05.941757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:05.942313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:05.942818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] PATH_INFO: `/v3/projects/6f127d6bcfe64a2694256fed07561a95` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:05.944022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] RBAC: Authorizing `identity:get_project(project_id=6f127d6bcfe64a2694256fed07561a95)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:05.945469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:05.952502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 207/429] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:05 2022] GET /identity/v3/projects/6f127d6bcfe64a2694256fed07561a95 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:05.953324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:05.993405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:06.062318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f6f0-4816-4a8a-a9b9-120c1b2e7c2a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:06.063396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5711b-8ce0-4be6-a071-4087778955c9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:06.100410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:06.100610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:06.101401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.101678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.101949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.102346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.102922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.103256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:06.103616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.105419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:06.107224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 208/430] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:05 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:06.107809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:06.117658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:06.129200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:06.130074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 10:09:06.131682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:06.132294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 223/431] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:06.132942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:06.146247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:06.218800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df4cf2-6b45-46db-93af-4766f85d4a7a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:06.264553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:06.265833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.266452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.267857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.269273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:06.270749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:06.270958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6f13a-e700-4974-9eb8-f80965a71ca1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:06.274754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 209/432] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:06 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:06.275792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:06.278237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:06.315008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:06.316177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.316679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.317175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.318301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=6f127d6bcfe64a2694256fed07561a95) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:06.318844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:06.320540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:06.327954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 224/433] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:09:06 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=9987e14f9f4744858d584c8867b2a56c => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:06.329181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:06.405860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386538a7-a8b2-4d93-8187-fef5a6c5a671 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:06.409569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:06.506074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fb59a-c329-48ee-9d62-c724950ba2eb None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:06.515544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:06.516226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.516506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.516778 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.517533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:06.517840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:06.519270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:06.534199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 210/434] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:09:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:06.539687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:06.551681 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6933c0-2fe2-4230-94ee-04c7a3b1b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:06.552352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6933c0-2fe2-4230-94ee-04c7a3b1b85c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.553084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6933c0-2fe2-4230-94ee-04c7a3b1b85c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.553397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6933c0-2fe2-4230-94ee-04c7a3b1b85c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.554605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6933c0-2fe2-4230-94ee-04c7a3b1b85c None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=6f127d6bcfe64a2694256fed07561a95) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:06.554949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6933c0-2fe2-4230-94ee-04c7a3b1b85c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:06.556941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6933c0-2fe2-4230-94ee-04c7a3b1b85c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:06.565262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 225/435] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:09:06 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=6f127d6bcfe64a2694256fed07561a95&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:06.668285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f9859-fce3-435c-9651-58cb0b3a3cbd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:06.711177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:06.711855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.712139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.712414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.755394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:06.781588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a55f0c-66ab-4df0-ac27-031ff3c9a2f3 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.781903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a55f0c-66ab-4df0-ac27-031ff3c9a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.782267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a55f0c-66ab-4df0-ac27-031ff3c9a2f3 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.786956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 226/436] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:06.789347 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1bc70-94f1-496a-b75e-d1549ed6ef96 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:06.789639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1bc70-94f1-496a-b75e-d1549ed6ef96 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:06.789925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1bc70-94f1-496a-b75e-d1549ed6ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:06.803836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:06.805821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:06.810407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2cd1bc70-94f1-496a-b75e-d1549ed6ef96 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:06.811669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2cd1bc70-94f1-496a-b75e-d1549ed6ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:06.851109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:06.908888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 227/437] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:06.929327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 211/438] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:09:06.933873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1bc70-94f1-496a-b75e-d1549ed6ef96 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:06.936848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.007536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.050948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1bc70-94f1-496a-b75e-d1549ed6ef96 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.059332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567e904-e95e-4dc1-a015-4b065224625c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.094390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca88175-1e77-4c0b-8da2-04528c259a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.095651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88175-1e77-4c0b-8da2-04528c259a8f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.096209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88175-1e77-4c0b-8da2-04528c259a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.096711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88175-1e77-4c0b-8da2-04528c259a8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.103036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322f713-98b2-4b94-91c3-9aa50a5b48b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.103929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322f713-98b2-4b94-91c3-9aa50a5b48b1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.104212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322f713-98b2-4b94-91c3-9aa50a5b48b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.104494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322f713-98b2-4b94-91c3-9aa50a5b48b1 None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.105694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322f713-98b2-4b94-91c3-9aa50a5b48b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.107322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322f713-98b2-4b94-91c3-9aa50a5b48b1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.108058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca88175-1e77-4c0b-8da2-04528c259a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:07.108908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 212/439] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:06 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:07.111276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7fcc-1b16-4f95-afad-3ee3b2e0d721 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.111562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7fcc-1b16-4f95-afad-3ee3b2e0d721 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.111839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de7fcc-1b16-4f95-afad-3ee3b2e0d721 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.113208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 213/440] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:07.116128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7fcc-1b16-4f95-afad-3ee3b2e0d721 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-2ca88175-1e77-4c0b-8da2-04528c259a8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:07.116545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:07.117389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:07.118191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 228/441] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:07.120412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e51ad7-8e43-406a-9d7f-3b216ce6050a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.120412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e51ad7-8e43-406a-9d7f-3b216ce6050a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.120532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e51ad7-8e43-406a-9d7f-3b216ce6050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.138156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-97e51ad7-8e43-406a-9d7f-3b216ce6050a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:07.139367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-97e51ad7-8e43-406a-9d7f-3b216ce6050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:07.159943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.221447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 229/442] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:07.222120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e51ad7-8e43-406a-9d7f-3b216ce6050a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.242237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de7fcc-1b16-4f95-afad-3ee3b2e0d721 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.272227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.277677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.278528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.278851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.279129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.280381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.281744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.283416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 214/443] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:07.284171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.321299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e51ad7-8e43-406a-9d7f-3b216ce6050a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.354918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.355591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.355877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.356156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.356898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:07.357216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.358596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.366765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 230/444] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:07.367546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.383560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.387172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b544-7211-465f-acad-86190d813ce6 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.420498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.421289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.421572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.421850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.432436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:07.440093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:07.441004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:07.441780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 215/445] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:07.443114 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.471525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731f2e-c6fb-4549-bdc6-1659af253620 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.501928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.507560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.508209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.508491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.508761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.509585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=9987e14f9f4744858d584c8867b2a56c, scope.project.id=c5c026b061f24637b96eff8ca60b86cb) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:07.509894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.511380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.517853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 231/446] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=9987e14f9f4744858d584c8867b2a56c => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:07.518633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.549783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41c26e-bf47-4784-ade3-1be596fe11ed None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.591210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.592086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.592373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.592651 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.611771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.637220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dd191-e7c2-4d92-ab1a-31ce37af4054 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.668563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.670121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.674099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.674877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.675161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.675439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.676190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:07.676496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.677856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.687435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 232/447] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:07.692908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.744175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.793126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 216/448] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:07.798329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.814631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0ce9-ccd3-4243-9233-538b16dca969 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.857999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.858669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.858973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.859319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.870567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:07.907946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0fcf-e4ba-48d4-b238-37d2813a1acb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:07.929636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.931145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.941740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:07.942586 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:07.942904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:07.943177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] PATH_INFO: `/v3/projects/c5c026b061f24637b96eff8ca60b86cb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:07.944342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] RBAC: Authorizing `identity:get_project(project_id=c5c026b061f24637b96eff8ca60b86cb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:07.946034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:07.947779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 217/449] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/projects/c5c026b061f24637b96eff8ca60b86cb => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:07.953243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:07.980294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:08.027646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 233/450] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 10:09:08.033134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:08.050000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b317-454d-4ab1-80df-add5e93b4fce None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:08.073401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:08.083135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:08.083976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:08.084254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:08.084545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] PATH_INFO: `/v3/groups/5c8702cf680646b591d2118ad5bfc650` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:08.085697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] RBAC: Authorizing `identity:get_group(group_id=5c8702cf680646b591d2118ad5bfc650)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:08.087171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:08.089294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 218/451] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:07 2022] GET /identity/v3/groups/5c8702cf680646b591d2118ad5bfc650 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:08.095019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:08.131674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5686764-6bc3-4826-808a-f179caec6d2f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:08.164636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:08.165478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:08.165755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:08.166026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] PATH_INFO: `/v3/projects/9982519b09d14f298a1a1f477137a258` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:08.167766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] RBAC: Authorizing `identity:get_project(project_id=9982519b09d14f298a1a1f477137a258)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:08.169190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:08.170892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 234/452] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:09:08 2022] GET /identity/v3/projects/9982519b09d14f298a1a1f477137a258 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:08.176267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:08.186780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:08.192626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559019ce-078a-4d5e-b9d2-9a6b12ffaa3e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:08.227269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:08.227915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:08.228194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:08.228469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:08.229321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] RBAC: Adding query filter params (group.id=5c8702cf680646b591d2118ad5bfc650, role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=c5c026b061f24637b96eff8ca60b86cb) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:08.229638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:08.231111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:08.236979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 219/453] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:09:08 2022] GET /identity/v3/role_assignments?group.id=5c8702cf680646b591d2118ad5bfc650&scope.project.id=c5c026b061f24637b96eff8ca60b86cb&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:08.281086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503e47-5cb0-432b-876e-6b1bbc18df8c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:08.291856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:08.318124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70567c3-a42e-43eb-9c99-1899bed2d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:08.319023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70567c3-a42e-43eb-9c99-1899bed2d2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:08.319305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70567c3-a42e-43eb-9c99-1899bed2d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:08.319578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70567c3-a42e-43eb-9c99-1899bed2d2b5 None admin] PATH_INFO: `/v3/groups/782b4a276de140568c71d535293227af` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:08.321033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70567c3-a42e-43eb-9c99-1899bed2d2b5 None admin] RBAC: Authorizing `identity:get_group(group_id=782b4a276de140568c71d535293227af)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:08.323010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70567c3-a42e-43eb-9c99-1899bed2d2b5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:08.324738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 235/454] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 30 10:09:08 2022] GET /identity/v3/groups/782b4a276de140568c71d535293227af => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:08.330636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:08.432169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce493ad-5902-46d2-bd02-42d9f2688f1b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:08.466747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb7d17-13fa-4906-89a7-d4aa5f5132d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:08.467480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7d17-13fa-4906-89a7-d4aa5f5132d1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:08.468767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7d17-13fa-4906-89a7-d4aa5f5132d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:08.469040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb7d17-13fa-4906-89a7-d4aa5f5132d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:08.469870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7d17-13fa-4906-89a7-d4aa5f5132d1 None admin] RBAC: Adding query filter params (group.id=782b4a276de140568c71d535293227af, role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=9982519b09d14f298a1a1f477137a258) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:08.470183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7d17-13fa-4906-89a7-d4aa5f5132d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:08.471661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb7d17-13fa-4906-89a7-d4aa5f5132d1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:08.477930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 220/455] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 30 10:09:08 2022] GET /identity/v3/role_assignments?group.id=782b4a276de140568c71d535293227af&scope.project.id=9982519b09d14f298a1a1f477137a258&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:11.169548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07888a4-3925-4e8d-9820-1490e063a429 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.170069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07888a4-3925-4e8d-9820-1490e063a429 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.170176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07888a4-3925-4e8d-9820-1490e063a429 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.171761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 236/456] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:11.177555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ecf-85c6-475d-a17c-3f7ac709b474 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.177987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ecf-85c6-475d-a17c-3f7ac709b474 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.178166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610ecf-85c6-475d-a17c-3f7ac709b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.203152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-83610ecf-85c6-475d-a17c-3f7ac709b474 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:11.204501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-83610ecf-85c6-475d-a17c-3f7ac709b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:11.227438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:11.285652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 221/457] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:11.321948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4949c0-89b1-4449-a516-127cb9d6e87e None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.322242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4949c0-89b1-4449-a516-127cb9d6e87e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.322533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4949c0-89b1-4449-a516-127cb9d6e87e None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.324185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 237/458] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:11.327338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83610ecf-85c6-475d-a17c-3f7ac709b474 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:11.329215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866463-f33e-435f-9718-a40a55e345af None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.329510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866463-f33e-435f-9718-a40a55e345af None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.329793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866463-f33e-435f-9718-a40a55e345af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.363731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-31866463-f33e-435f-9718-a40a55e345af None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:11.365395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-31866463-f33e-435f-9718-a40a55e345af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:11.479808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83610ecf-85c6-475d-a17c-3f7ac709b474 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:11.518991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 238/459] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:11.520590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5a89-5640-4761-a7ac-5a5ab77743ad None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.520882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5a89-5640-4761-a7ac-5a5ab77743ad None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.521164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f5a89-5640-4761-a7ac-5a5ab77743ad None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.522732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 239/460] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:11.533047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979331-5d54-4884-a335-f85524a51f71 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.533335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979331-5d54-4884-a335-f85524a51f71 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.533617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979331-5d54-4884-a335-f85524a51f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.543456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:11.544270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.544554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.544832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.551462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-82979331-5d54-4884-a335-f85524a51f71 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:11.552661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-82979331-5d54-4884-a335-f85524a51f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:11.564731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:11.566346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:11.586224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:11.587167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:11.588558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:11.588558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:11.588558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:11.588558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:11.592758 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 222/461] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:11.593618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:11.602676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:11.630849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 240/462] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:11.630849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979331-5d54-4884-a335-f85524a51f71 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:11.667207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:11.699033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da89d6-ffcd-4a27-9343-5f5222bd55dc None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:11.734966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecd981-f856-43f6-858d-bf9c192899e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:11.735683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecd981-f856-43f6-858d-bf9c192899e9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.735969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecd981-f856-43f6-858d-bf9c192899e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.736205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979331-5d54-4884-a335-f85524a51f71 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:11.736309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecd981-f856-43f6-858d-bf9c192899e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.746712 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecd981-f856-43f6-858d-bf9c192899e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:11.748213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecd981-f856-43f6-858d-bf9c192899e9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-40ecd981-f856-43f6-858d-bf9c192899e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:11.765805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:11.766655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:11.767545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:11.767545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:11.767545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:11.767545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:11.767545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 223/463] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:11.768267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5c4e-08a4-4ef6-8f17-2381e0430984 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.768558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5c4e-08a4-4ef6-8f17-2381e0430984 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.768837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5c4e-08a4-4ef6-8f17-2381e0430984 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.770236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 224/464] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:11.772390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5c4e-08a4-4ef6-8f17-2381e0430984 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:11.780747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:11.781415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.781698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.781974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.782712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:11.783035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:11.784422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:11.796844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 241/465] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:11.797659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:11.841364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:11.893761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5c4e-08a4-4ef6-8f17-2381e0430984 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:11.897238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:11.904616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594798e5-31b3-4a16-9a86-facf832c551c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:11.935357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:11.936413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.936929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.937396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.943801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7bb16-5792-48cb-b279-f2990206f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:11.944460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7bb16-5792-48cb-b279-f2990206f449 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.944749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7bb16-5792-48cb-b279-f2990206f449 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.945030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7bb16-5792-48cb-b279-f2990206f449 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.946451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7bb16-5792-48cb-b279-f2990206f449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:11.946799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7bb16-5792-48cb-b279-f2990206f449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:11.949073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7bb16-5792-48cb-b279-f2990206f449 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:11.950208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:11.951711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:11.963865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 242/466] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:11.965387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b8940-c0e5-4634-9234-d98f5ad7e959 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:11.965875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b8940-c0e5-4634-9234-d98f5ad7e959 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:11.966351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b8940-c0e5-4634-9234-d98f5ad7e959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:11.970169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:11.971186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:11.972250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:11.972250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:11.972250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:11.972250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:11.972250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 225/467] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:11.972250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:11.991238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3c1b8940-c0e5-4634-9234-d98f5ad7e959 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:11.992926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3c1b8940-c0e5-4634-9234-d98f5ad7e959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:12.065103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 243/468] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:12.066150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b8940-c0e5-4634-9234-d98f5ad7e959 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:12.080291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353f6ce-78b8-4ef1-b9e2-89d660cb0281 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.092196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:12.117108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.117777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.118059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.118332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.119515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.121321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.142653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 226/469] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:09:11 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:12.143935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:12.186279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:12.207526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b8940-c0e5-4634-9234-d98f5ad7e959 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.253547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.254720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.255264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.255784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.256797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.258566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.286100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 244/470] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:09:12 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:12.288358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:12.299107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e23d-cdf0-41d1-929a-18921771f043 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.341200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.341876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.342213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.342492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.343275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:12.343586 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.345347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.359155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 227/471] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:12.363945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:12.397094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:12.428577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084fda-6617-47f1-9f0d-11b752302d63 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.480348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55955c8-0af0-4e33-8b03-cb6657f1a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.481091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55955c8-0af0-4e33-8b03-cb6657f1a4db None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.481373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55955c8-0af0-4e33-8b03-cb6657f1a4db None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.481647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55955c8-0af0-4e33-8b03-cb6657f1a4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.496774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55955c8-0af0-4e33-8b03-cb6657f1a4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.498500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55955c8-0af0-4e33-8b03-cb6657f1a4db None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.500975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11592d-481e-491e-9b71-2f3f0fcde33b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.502240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c55955c8-0af0-4e33-8b03-cb6657f1a4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:12.523233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:12.524109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:12.525771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:12.525771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:12.525771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:12.525771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:12.525771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 245/472] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:12.526357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3c11-d304-418a-ac75-05f89c1bdaf8 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.526641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3c11-d304-418a-ac75-05f89c1bdaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.528307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3c11-d304-418a-ac75-05f89c1bdaf8 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.529208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 246/473] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:12.535577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3c11-d304-418a-ac75-05f89c1bdaf8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:12.551428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01aeaf4-6bd5-4467-bd81-4e8ade12f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.552136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aeaf4-6bd5-4467-bd81-4e8ade12f924 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.552418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aeaf4-6bd5-4467-bd81-4e8ade12f924 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.552691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01aeaf4-6bd5-4467-bd81-4e8ade12f924 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.553461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aeaf4-6bd5-4467-bd81-4e8ade12f924 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.555971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01aeaf4-6bd5-4467-bd81-4e8ade12f924 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.581186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 228/474] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:09:12 2022] POST /identity/v3/users => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:09:12.582826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd26d88-b7d0-4ae5-812a-b51e110a6284 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.583302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd26d88-b7d0-4ae5-812a-b51e110a6284 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.583745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd26d88-b7d0-4ae5-812a-b51e110a6284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.603120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-fbd26d88-b7d0-4ae5-812a-b51e110a6284 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:12.604659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fbd26d88-b7d0-4ae5-812a-b51e110a6284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:12.685933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 229/475] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:12.699523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3c11-d304-418a-ac75-05f89c1bdaf8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.738484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.738892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd26d88-b7d0-4ae5-812a-b51e110a6284 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:12.739190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.739474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.739750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.740612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:12.740921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.746731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.758123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 247/476] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:12.764279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:12.780575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:12.843060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:12.899855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301d13-e0ab-4070-afca-41619db398f1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.903928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd26d88-b7d0-4ae5-812a-b51e110a6284 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:12.944890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.945714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.946137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:12.946453 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.946858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.947336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:12.947846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:12.947955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.948343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:12.949180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:12.949672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.950954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:12.961366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.sql.core [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:09:12.961366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 10:09:12.961366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [parameters: {'id': 'c1ace97b6fe64d62b51d55e48f38cac8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 10:09:12.961366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80026) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:09:12.974727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 248/477] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:09:12 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application result.read() Jun 30 10:09:12.983694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return ref.to_dict() Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:09:12.984786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application yield resource Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise self.value Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application session.commit() Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:09:12.985815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:09:12.987150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:09:12.988054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application result.read() Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:09:12.988915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [parameters: {'id': 'c1ace97b6fe64d62b51d55e48f38cac8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:12.989724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 10:09:12.990513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:12.993378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 230/478] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 30 10:09:12 2022] POST /identity/v3/roles => generated 144 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:12.999800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:13.119305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a92a23-6e32-47c8-82a1-da7942335a80 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:13.130795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:13.156422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bd33a-2630-44b0-b189-0994447844be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:13.157237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd33a-2630-44b0-b189-0994447844be None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:13.157518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd33a-2630-44b0-b189-0994447844be None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:13.157876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd33a-2630-44b0-b189-0994447844be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:13.170676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bd33a-2630-44b0-b189-0994447844be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c11bd33a-2630-44b0-b189-0994447844be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:13.178862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:13.179788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:13.180977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 249/479] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:13.191080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:13.296946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:13.324974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c60ef-ee37-4284-a3b4-fddad2cdb71e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:13.362032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4540906-f140-4b10-be4f-934290f1aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:13.362717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540906-f140-4b10-be4f-934290f1aab4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:13.363005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540906-f140-4b10-be4f-934290f1aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:13.363280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4540906-f140-4b10-be4f-934290f1aab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:13.364030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4540906-f140-4b10-be4f-934290f1aab4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:13.364331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4540906-f140-4b10-be4f-934290f1aab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:13.365716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4540906-f140-4b10-be4f-934290f1aab4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:13.375067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 231/480] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:14.673059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2da8f-a30d-41f9-9c52-1e9ecde72573 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:14.673752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2da8f-a30d-41f9-9c52-1e9ecde72573 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:14.673752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2da8f-a30d-41f9-9c52-1e9ecde72573 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:14.675288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 250/481] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:14.680330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4b84-a203-4ae0-ad02-d489df92bc85 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:14.680810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4b84-a203-4ae0-ad02-d489df92bc85 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:14.680965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4b84-a203-4ae0-ad02-d489df92bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:14.684041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0da89-388b-4c66-be5c-76a81e720653 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:14.684326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0da89-388b-4c66-be5c-76a81e720653 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:14.684600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0da89-388b-4c66-be5c-76a81e720653 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:14.685848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 251/482] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:14.691192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11d976-3d3e-48c3-bf4d-1ba8309ac8fc None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:14.691706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11d976-3d3e-48c3-bf4d-1ba8309ac8fc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:14.692310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11d976-3d3e-48c3-bf4d-1ba8309ac8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:14.710218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9f11d976-3d3e-48c3-bf4d-1ba8309ac8fc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:14.711842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9f11d976-3d3e-48c3-bf4d-1ba8309ac8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:14.715649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-66ed4b84-a203-4ae0-ad02-d489df92bc85 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:14.716827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-66ed4b84-a203-4ae0-ad02-d489df92bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:14.813669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 232/483] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:14.839435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed4b84-a203-4ae0-ad02-d489df92bc85 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:14.847230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 252/484] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:14.892105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11d976-3d3e-48c3-bf4d-1ba8309ac8fc None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:14.942269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:14.982244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed4b84-a203-4ae0-ad02-d489df92bc85 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.026652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.027480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.027762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.028038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.046433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:15.055106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:15.056084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:15.057939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 233/485] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:15.065524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.111012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:15.114180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11d976-3d3e-48c3-bf4d-1ba8309ac8fc None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.181270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.182884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.183261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.183542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.213752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:15.222061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:15.223027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:15.223821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:15.230383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4cc2c-4ad7-4c48-8149-1a38eb5694b9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.231770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 253/486] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:15.239677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.263124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:15.276105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.277138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.277624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.278120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.279516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:15.281031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:15.282638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:15.297730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 234/487] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:15.303005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.388725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6025d-f7ed-4f22-9bf6-5e76116ebbc2 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.421590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e87cd8-d97d-4bd6-b218-07dbb0910dda None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.425637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.426618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.427152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.427645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.428586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:15.429088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:15.430676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:15.440046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 254/488] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:15.447933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.467528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079b047-eda4-44ee-875d-9ecbf1e61a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.468315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079b047-eda4-44ee-875d-9ecbf1e61a28 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.468595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079b047-eda4-44ee-875d-9ecbf1e61a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.468862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079b047-eda4-44ee-875d-9ecbf1e61a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.487384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079b047-eda4-44ee-875d-9ecbf1e61a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:15.488871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079b047-eda4-44ee-875d-9ecbf1e61a28 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:15.502496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-d079b047-eda4-44ee-875d-9ecbf1e61a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:15.519887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:15.520789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:15.521620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:15.521620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:15.521620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:15.521620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:15.523790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 235/489] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:15.526181 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1da926-93a5-401b-b7ad-1655c40c30e7 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.526675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1da926-93a5-401b-b7ad-1655c40c30e7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.527179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1da926-93a5-401b-b7ad-1655c40c30e7 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.532767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 236/490] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:15.532767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1da926-93a5-401b-b7ad-1655c40c30e7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.580356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:15.604341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b672-1693-4f76-a7dd-edad3a5fbdf7 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.641195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64764625-d6bf-4c79-a12c-186182d8dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.641550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1da926-93a5-401b-b7ad-1655c40c30e7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.642547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764625-d6bf-4c79-a12c-186182d8dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.643186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764625-d6bf-4c79-a12c-186182d8dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.643656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64764625-d6bf-4c79-a12c-186182d8dcd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.656029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64764625-d6bf-4c79-a12c-186182d8dcd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:15.657998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64764625-d6bf-4c79-a12c-186182d8dcd7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-64764625-d6bf-4c79-a12c-186182d8dcd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:15.677614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:15.678940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:15.679803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:15.679803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:15.679803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:15.679803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:15.680424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.681065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.681346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.681620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.682429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:15.682776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:15.683569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 255/491] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:15.684223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:15.685268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb66a13-b914-4560-b4cd-ab62d10bec2a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.685903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb66a13-b914-4560-b4cd-ab62d10bec2a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.686415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb66a13-b914-4560-b4cd-ab62d10bec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.699415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 237/492] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:15.704665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.709495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-dcb66a13-b914-4560-b4cd-ab62d10bec2a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:15.710957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-dcb66a13-b914-4560-b4cd-ab62d10bec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:15.785299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 256/493] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:15.786571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb66a13-b914-4560-b4cd-ab62d10bec2a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.790044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:15.809902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e6ed7-792a-4ffd-8a80-8fabaef947f3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.811848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:15.849794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.850455 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.850761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.851038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.851900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:15.852207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:15.853718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:15.871412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 238/494] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:15.871412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:15.899401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb66a13-b914-4560-b4cd-ab62d10bec2a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.941738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2aa69-f9ca-4312-b18e-99bf1579974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:15.942532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2aa69-f9ca-4312-b18e-99bf1579974c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.942862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2aa69-f9ca-4312-b18e-99bf1579974c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.943160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2aa69-f9ca-4312-b18e-99bf1579974c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.951352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2aa69-f9ca-4312-b18e-99bf1579974c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:15.952820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2aa69-f9ca-4312-b18e-99bf1579974c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-04f2aa69-f9ca-4312-b18e-99bf1579974c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:15.970423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:15.971380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:15.972285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 257/495] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:15.972857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438139c6-b039-43e8-b581-ab728c363052 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:15.973581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bb44-8768-472e-ac25-d2a51fba7292 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:15.973581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bb44-8768-472e-ac25-d2a51fba7292 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:15.973835 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469bb44-8768-472e-ac25-d2a51fba7292 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:15.975286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 258/496] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:15.977814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bb44-8768-472e-ac25-d2a51fba7292 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.011889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60dcb9-75d1-493d-a592-c09b2b32cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.012686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60dcb9-75d1-493d-a592-c09b2b32cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.013695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60dcb9-75d1-493d-a592-c09b2b32cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.013695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60dcb9-75d1-493d-a592-c09b2b32cca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.023354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60dcb9-75d1-493d-a592-c09b2b32cca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7a60dcb9-75d1-493d-a592-c09b2b32cca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:16.031621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:16.032483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:16.033297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 239/497] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:16.034098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7d55a-bc00-4b6b-9e99-9a1d7d6b9065 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.034442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7d55a-bc00-4b6b-9e99-9a1d7d6b9065 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.034628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7d55a-bc00-4b6b-9e99-9a1d7d6b9065 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.035919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 240/498] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:16.036618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7d55a-bc00-4b6b-9e99-9a1d7d6b9065 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.044601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.061713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.082872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469bb44-8768-472e-ac25-d2a51fba7292 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.116335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec975e2-e7e1-42c0-8ff3-40ee9d171bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.117108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec975e2-e7e1-42c0-8ff3-40ee9d171bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.117391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec975e2-e7e1-42c0-8ff3-40ee9d171bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.117663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec975e2-e7e1-42c0-8ff3-40ee9d171bd0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.125341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec975e2-e7e1-42c0-8ff3-40ee9d171bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:16.126818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec975e2-e7e1-42c0-8ff3-40ee9d171bd0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:16.139842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7d55a-bc00-4b6b-9e99-9a1d7d6b9065 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-5ec975e2-e7e1-42c0-8ff3-40ee9d171bd0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:16.142499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:16.143595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:16.144508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 259/499] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:16.145062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1f968-36ae-4478-910d-e97490939498 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.145222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1f968-36ae-4478-910d-e97490939498 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.145470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1f968-36ae-4478-910d-e97490939498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.161253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b9b1f968-36ae-4478-910d-e97490939498 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:16.162364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b9b1f968-36ae-4478-910d-e97490939498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:16.176662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.177323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.177602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.177880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.178732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:16.179048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:16.180572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:16.217392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 241/500] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:16.218221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.227583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 260/501] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:16.228864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80deac-0df1-40ca-9927-84b3469e3732 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.229147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80deac-0df1-40ca-9927-84b3469e3732 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.229458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80deac-0df1-40ca-9927-84b3469e3732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.247627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3d80deac-0df1-40ca-9927-84b3469e3732 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:16.249214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3d80deac-0df1-40ca-9927-84b3469e3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:16.300704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.310362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.319527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 261/502] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:16.320343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80deac-0df1-40ca-9927-84b3469e3732 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.330449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cad18-de80-4303-bedc-dd98cc565a89 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.363921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.364589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.364870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.365145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.365885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:16.366192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:16.367602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:16.376057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 242/503] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:16.376876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.418872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80deac-0df1-40ca-9927-84b3469e3732 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.452453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.453117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.453400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.453671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.454505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:16.454846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:16.456271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:16.476827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9918d-919b-4ecf-aaea-d68458403f9d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.493894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 262/504] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:16.495387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.511866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.512507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.512785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.513058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.524765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.537995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.582598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:16.584121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:16.593914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f3545-0c15-4c84-8a84-ec6b493db3e9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.627525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.628317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.628602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.628889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.638773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:16.646477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:16.647363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:16.648153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 263/505] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:16.648826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.684478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 243/506] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:16.685239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.727788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.750808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccb7a0-5e16-4c7c-8226-15c7f27e2d69 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.752677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.784851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.790428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.790428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.790428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.793172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896589d-0069-4811-8ca1-c62afe240ec0 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.797795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:16.799297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:16.816353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:16.817296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:16.818147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:16.818147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:16.818147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:16.818147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:16.818147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 264/507] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:16.818416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.832354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.833137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.833420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.833697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.844171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:16.845633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:16.864961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:16.865977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:16.866878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:16.866878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:16.866878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:16.866878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:16.866878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 244/508] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:16.867150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:16.919988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4930de-fe88-4fb2-ba94-f9deecdce425 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.954345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:16.954936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:16.955222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:16.955499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:16.961588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:16.968956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed77eb-6aba-4e13-8505-917840068a36 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:16.979378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.002452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.003137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.003417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.003689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.004426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:17.004730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.006100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.013940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 245/509] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:17.014748 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.023876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.025328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.111477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89b407-6804-43f0-b411-c8ee933dddc1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.123889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 265/510] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:17.124706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.148763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.149544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.149829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.150106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.160961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.162412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.178895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:17.179759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:17.180761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:17.181663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:17.181663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:17.181663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:17.181663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:17.181663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 246/511] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:17.181949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.193514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.227076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b184e-c482-4c2f-82d6-19ccf5f295f7 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.259155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.259801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.260636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.260907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.261617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:17.261919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.263323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.274047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 266/512] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:17.274849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.282846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c07a8-f7da-4347-8b73-c076664c3cdb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.316457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.317117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.317604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.318112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.319393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:17.319710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.323098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.335395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 247/513] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:17.336123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.383186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178f42e-1798-41d9-ba30-5c7f74c5fe35 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.396710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.402506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.418557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.419477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.419767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.420044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.430285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.431833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.439482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba5b3b-8569-4064-b37a-9b2f400f6a6b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:17.449441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:17.450273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:17.455684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:17.455684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:17.455684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:17.455684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:17.455684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 267/514] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:17.455684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.478084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.478853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.479141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.479415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.489998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.491632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:17.512796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:17.513817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:17.514917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:17.514917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:17.514917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:17.514917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:17.514917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 248/515] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:17.519094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.550812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e449-65d1-4e77-8ce8-43f313f255d5 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.584331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.584988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.585273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.585553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.586270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:17.586581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.588064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.600025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 268/516] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:17.600813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.626213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0671f2-1aa6-4da8-b49f-c4a75c272c32 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.628909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.647120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.662069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.662760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.663047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.663327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.664033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.665488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.685812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 249/517] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:09:17 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:17.687550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.706234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da53dcd-7f8f-4509-8871-e82e82949f3d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.745789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.746918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.747368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.747798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.756577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.758117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:17.774411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:17.775642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 269/518] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:17.781408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.810438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ad820-741b-4bc1-86c2-de3ca8f1bae2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.850829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.851589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.851946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.852306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.853294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:17.853407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.854852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.872663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 250/519] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:17.872663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.881658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.901284 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872fee-2745-42b0-8c3e-8b06382053bf None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:17.907565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:17.941323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:17.942074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:17.942256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:17.942533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:17.943280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:17.943593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:17.944966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:17.957751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 270/520] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:17.958569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:17.977700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916252d-48f2-4c3f-aeb4-faa0dda28cd0 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.013714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.014728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.015055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.015387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.022222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.023698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:18.038473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:18.039380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:18.040227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 251/521] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:18.041668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.074101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f69e2-9e4d-426f-bdf9-2377ffacd839 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.110144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.110829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.111112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.111384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.112213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:18.112520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.113951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.137792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 271/522] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:09:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:18.137792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.142026 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.142508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.148152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c6b11-a3fa-4f8d-bd81-2059ffb81fd4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.188982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.189782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.190063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.190338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.199167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.200666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:18.216174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:18.217066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:18.217936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 252/523] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:18.218610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.250817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288c09e-98f6-4831-9622-faf68225df5f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.288508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.289381 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.289664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.289952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.297228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.298667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:18.313995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:18.315095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:18.315959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:18.319882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 272/524] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:18.320503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.329211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e599-8b87-489d-bc5e-99dd537895fc None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.365416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.366334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.366792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.367228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.368153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:18.368603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.370316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.388739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.394198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 253/525] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:18.394198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.412619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.437131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff619de0-17bb-4db6-a6d4-309f326373a9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.476682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.477600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.477883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.478270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.498865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298b7f0-8334-4e6c-8a2a-a259056ca638 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.533459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.534229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.534516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.534824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.535666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:18.535976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.537515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.558793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 254/526] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:18.559914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.564526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.565982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.630013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.633700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.659653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d92aed-b371-456f-be2c-728faec12c19 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.676084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 273/527] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:18.676084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.701030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.701871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.702238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.702673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.703554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:18.703931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.705439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.717184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 255/528] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:18.717978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.782592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bf58-819e-4066-a6da-772ac049343c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.820731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.821580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.821863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.822140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.823581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=e40a1f11c5cd4b48be27dd1a0f48bdc9) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:18.823901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.825393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.827252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039febf-6c38-46b8-929f-c1086b809bbe None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:18.842951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 274/529] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/role_assignments?user.id=e40a1f11c5cd4b48be27dd1a0f48bdc9&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:18.842951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:18.865361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:18.866029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:18.866317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:18.866595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:18.869971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.887076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:18.968558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:18.971012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:18.979883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc88424-cb59-48eb-817d-1795dc555560 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.027011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.030446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.030748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.031027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.041045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:19.042620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:19.059885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:19.062189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:19.062189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:19.062189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:19.062189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:19.062189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 275/530] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:19.062189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.095652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 256/531] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:19.097760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.138111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:19.154811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:19.181376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb1c1-e410-4119-afcb-3b00d2c8b535 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.220336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6d758-abc6-4048-a55a-dfe53eec6647 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.223688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.224334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.224685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.225819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.225932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=b5eb306a63e14e57a10d468a4aa65db0) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:19.226317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:19.227862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:19.238976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 276/532] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/role_assignments?user.id=b5eb306a63e14e57a10d468a4aa65db0&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:19.240045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.280203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.280900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.281181 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.281452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.282190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:19.282498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:19.283978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:19.317376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 257/533] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:19.324705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.389851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6c54-1e84-4ca1-8ac7-75efe195f5ff None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.450475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.451334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.451617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.451893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.472015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:19.474802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:19.479261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:19.483365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:19.485542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f331d7-9231-4f6a-8b36-106ba40d7c55 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:19.507457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:19.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:19.509573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:19.509573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:19.509573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:19.509573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:19.511950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 277/534] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:19.519697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.539152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.539946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.540226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.540494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.553769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:19.556501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:19.585409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:19.586307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:19.587160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:19.591099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 258/535] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:19.596621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.722422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc1f5c-b054-473e-bbbd-056682b4b843 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.733898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71554fe-19d1-485b-a1d5-eb82f67af70e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.781071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.782137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.783326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.784301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.785372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:19.786276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:19.789812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:19.793443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.794653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.795177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.795630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.796514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:19.796988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:19.798551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:19.811743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 278/536] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:19.816139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 259/537] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:19.817725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.821821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:19.849426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:19.896871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:19.953342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbc79c-ab0b-494c-a4a4-9c3d21505dbc None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.955104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a22917-b1ba-4803-a103-a0f916cf4889 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:19.997276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc7d6c-06eb-4898-a3ea-985dc738d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.998318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc7d6c-06eb-4898-a3ea-985dc738d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.998437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:19.998910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc7d6c-06eb-4898-a3ea-985dc738d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.999238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:19.999527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:19.999626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc7d6c-06eb-4898-a3ea-985dc738d0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:19.999802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.000942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc7d6c-06eb-4898-a3ea-985dc738d0a3 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=a8c2616d20ea41f7ad4f953138f5636e) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:20.001414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc7d6c-06eb-4898-a3ea-985dc738d0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:20.003239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc7d6c-06eb-4898-a3ea-985dc738d0a3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:20.006933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:20.008384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:20.010231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 260/538] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/role_assignments?user.id=a8c2616d20ea41f7ad4f953138f5636e&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:20.011799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7550-f541-4dbe-9f2e-cff55b4fafe8 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:20.012264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7550-f541-4dbe-9f2e-cff55b4fafe8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:20.012708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7550-f541-4dbe-9f2e-cff55b4fafe8 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.014526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 261/539] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:20.020424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c591078-d787-4c23-b8d2-105cf0f5aaf8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:20.021028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c591078-d787-4c23-b8d2-105cf0f5aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:20.021519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c591078-d787-4c23-b8d2-105cf0f5aaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:20.023095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:20.023914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:20.024739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 279/540] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:20.033376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:20.063395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-9c591078-d787-4c23-b8d2-105cf0f5aaf8 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:20.064918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9c591078-d787-4c23-b8d2-105cf0f5aaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:20.178421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 262/541] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:20.208280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c591078-d787-4c23-b8d2-105cf0f5aaf8 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:20.220684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5532-c5a1-4618-a2a0-bdf2d845e65e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:20.221976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:20.239405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:20.262290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:20.262640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:20.263022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:20.263362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.264218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:20.264598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:20.266107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:20.286568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 280/542] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:20.298716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:20.407258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9425-28ba-444f-8d04-488227bec6bd None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:20.424635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c591078-d787-4c23-b8d2-105cf0f5aaf8 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:20.447821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:20.448638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:20.449027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:20.449408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.450351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=c11a44c395ae45fcba4e0c0fe08695c3) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:20.450816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:20.452945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:20.459603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 281/543] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:20 2022] GET /identity/v3/role_assignments?user.id=c11a44c395ae45fcba4e0c0fe08695c3&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:20.501037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:20.501860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:20.502144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:20.502416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.516202 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:20.524164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:20.525099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:20.526454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:20.530835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 263/544] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:20.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:20.591097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:20.648540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098ce39-0d47-419f-9383-e0fb01979b4b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:20.690757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:20.691098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:20.691480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:20.691886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.692738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:20.693145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:20.694544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:20.708622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 282/545] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:20.709988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:20.782083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:20.821475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9bf33-774b-47bb-85d1-c59647f144b5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:20.859376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:20.860480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:20.861195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:20.861644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:20.873641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:20.875351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:20.896857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:20.897723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:20.898546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:20.898546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:20.898546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:20.898546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:20.900757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 264/546] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:20.906228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:21.063629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73460cae-c724-4741-ad84-361fd8f9bc1a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:21.067061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:21.099917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86f2f4-80ac-4ca9-b198-9bfb3742e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:21.100582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f2f4-80ac-4ca9-b198-9bfb3742e62f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.100860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f2f4-80ac-4ca9-b198-9bfb3742e62f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.101127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86f2f4-80ac-4ca9-b198-9bfb3742e62f None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.101851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86f2f4-80ac-4ca9-b198-9bfb3742e62f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:21.102159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86f2f4-80ac-4ca9-b198-9bfb3742e62f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:21.104086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86f2f4-80ac-4ca9-b198-9bfb3742e62f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:21.116422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 283/547] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:21.127782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:21.243383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd66b5a-97ee-49b4-b704-1a3a15034939 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:21.264301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419009-0521-47ae-b0fc-68a5bd180885 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.264605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419009-0521-47ae-b0fc-68a5bd180885 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.264860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419009-0521-47ae-b0fc-68a5bd180885 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.266475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 284/548] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:21.269498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:21.271344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e503-015e-4f97-a8c3-ff3c752314f7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.271630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e503-015e-4f97-a8c3-ff3c752314f7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.271907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e503-015e-4f97-a8c3-ff3c752314f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.292004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-47c8e503-015e-4f97-a8c3-ff3c752314f7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:21.294093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-47c8e503-015e-4f97-a8c3-ff3c752314f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:21.303955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:21.304758 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.305036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.305308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.318034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:21.319454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:21.343436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:21.344875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:21.346128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 265/549] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:21.357248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:21.428626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 285/550] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:21.475333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e503-015e-4f97-a8c3-ff3c752314f7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:21.509147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36fdb0-bbfa-4519-8039-870de6f3484a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:21.547736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:21.548641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.549063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.549512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.550483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:21.550965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:21.553009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:21.573187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 266/551] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 30 10:09:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:21.583711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:21.620864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:21.631465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e503-015e-4f97-a8c3-ff3c752314f7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:21.670969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973781ee-bf1e-4499-b82f-88ca4b6d7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:21.672636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973781ee-bf1e-4499-b82f-88ca4b6d7b4f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.672921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973781ee-bf1e-4499-b82f-88ca4b6d7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.673202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973781ee-bf1e-4499-b82f-88ca4b6d7b4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.679013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:21.688226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973781ee-bf1e-4499-b82f-88ca4b6d7b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-973781ee-bf1e-4499-b82f-88ca4b6d7b4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:21.699234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:21.700413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:21.701472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:21.704276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 286/552] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:21.705725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245334af-d2cd-4f8e-b439-955a03702d9c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.706157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245334af-d2cd-4f8e-b439-955a03702d9c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.706561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245334af-d2cd-4f8e-b439-955a03702d9c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.707971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 287/553] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:21.709853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245334af-d2cd-4f8e-b439-955a03702d9c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:21.752281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82130233-4e4f-4729-aee8-f77a79b3b73b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:21.799052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:21.799746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.800445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.800945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.838884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245334af-d2cd-4f8e-b439-955a03702d9c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:21.880292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5e152-a092-43b3-97df-0312e01dfaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:21.880952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e152-a092-43b3-97df-0312e01dfaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.881231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e152-a092-43b3-97df-0312e01dfaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.881504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5e152-a092-43b3-97df-0312e01dfaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.882241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5e152-a092-43b3-97df-0312e01dfaa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:21.882545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5e152-a092-43b3-97df-0312e01dfaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:21.883958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5e152-a092-43b3-97df-0312e01dfaa5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:21.897222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 288/554] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:21.897484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:21.899058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098113-4cfc-4a91-b9b8-4ea68b9941cc None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:21.899550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098113-4cfc-4a91-b9b8-4ea68b9941cc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:21.900024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098113-4cfc-4a91-b9b8-4ea68b9941cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:21.904080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:21.921213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-25098113-4cfc-4a91-b9b8-4ea68b9941cc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:21.923484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-25098113-4cfc-4a91-b9b8-4ea68b9941cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:21.936936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:21.948844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.015822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 289/555] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:22.017579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098113-4cfc-4a91-b9b8-4ea68b9941cc None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.030086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 267/556] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:22.035018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.155787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd784bb7-5538-4179-8cab-78372d7eeda3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.169623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098113-4cfc-4a91-b9b8-4ea68b9941cc None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.199515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.200592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.201021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.201442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.208670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.212263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.213314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.213587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.213901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.214324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.215082 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.225342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.226990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.229740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:22.233458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:22.234521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:22.235627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:22.235627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:22.235627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:22.235627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:22.238816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 268/557] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:22.239640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:22.250377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:22.251987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:22.253061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:22.253061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:22.253061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:22.253061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:22.254916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 290/558] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:22.255884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.347880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d65dc-798d-4a5f-a030-ffafe513cc10 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.361224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa899c-d9ab-46af-b679-f15556773de5 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.384134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.385486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.385771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.386046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.396990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:22.399229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.400097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.400588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.401051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.401954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:22.402460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.404030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:22.404882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:22.405907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:22.406781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 269/559] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:22.407474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.420051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 291/560] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:22.421189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.468597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.481771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.528324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcfc0f-781e-4189-91f4-ddfb27b96946 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.529367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd62e51-8236-4f16-a2fe-9cfe2d264c30 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.564492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d263553-3961-4c01-ac0c-255abe20d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.565159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263553-3961-4c01-ac0c-255abe20d88c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.565442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263553-3961-4c01-ac0c-255abe20d88c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.565573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.565780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263553-3961-4c01-ac0c-255abe20d88c None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.566188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.566461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263553-3961-4c01-ac0c-255abe20d88c None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:22.566560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.566756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.566855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263553-3961-4c01-ac0c-255abe20d88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.567481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:22.567791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.568150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263553-3961-4c01-ac0c-255abe20d88c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.569152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.581959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 292/561] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:22.581959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd339f-37f0-4113-a841-1a6e22201b43 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.581959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd339f-37f0-4113-a841-1a6e22201b43 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.581959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd339f-37f0-4113-a841-1a6e22201b43 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.582857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 293/562] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:22.583705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd339f-37f0-4113-a841-1a6e22201b43 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.594814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 270/563] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:22.594814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.697480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd339f-37f0-4113-a841-1a6e22201b43 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.702119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f171-a82c-487c-a529-6d63d416cc05 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.713358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.717066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.736197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd89b-a69f-4964-869d-1480aa5095d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.737056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd89b-a69f-4964-869d-1480aa5095d3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.737349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd89b-a69f-4964-869d-1480aa5095d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.737625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd89b-a69f-4964-869d-1480aa5095d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.742412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.743442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.743795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.744075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.745263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd89b-a69f-4964-869d-1480aa5095d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.746763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd89b-a69f-4964-869d-1480aa5095d3 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.755449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.756903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c70dd89b-a69f-4964-869d-1480aa5095d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:22.761909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:22.762811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:22.763705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 294/564] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:22.764652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6271101-7a16-4142-8e29-0d15c6ed706f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.764920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6271101-7a16-4142-8e29-0d15c6ed706f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.765215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6271101-7a16-4142-8e29-0d15c6ed706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:22.779488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:22.780409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:22.781311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:22.781311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:22.781311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:22.781311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:22.781311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 271/565] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:22.781595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.786289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a6271101-7a16-4142-8e29-0d15c6ed706f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:22.787432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a6271101-7a16-4142-8e29-0d15c6ed706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:22.861973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 295/566] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:22.862912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6271101-7a16-4142-8e29-0d15c6ed706f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.901795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f221a9-23be-48e5-a47a-a72f63a3f337 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.936617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:22.937407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:22.937698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:22.937973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:22.945150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:22.946916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:22.966362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:22.967549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 272/567] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:22.968828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:22.986498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6271101-7a16-4142-8e29-0d15c6ed706f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:22.992601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:22.995868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.020913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.021570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.021853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.022131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.022973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:23.023286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.024731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.036576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 296/568] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:23.037363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.067570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc232ee-0232-4a02-a615-c8cf53eb75d7 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.101865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fa049-3664-41fe-b915-bf7a6b17f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.102516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fa049-3664-41fe-b915-bf7a6b17f597 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.102837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fa049-3664-41fe-b915-bf7a6b17f597 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.103119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fa049-3664-41fe-b915-bf7a6b17f597 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.104381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fa049-3664-41fe-b915-bf7a6b17f597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:23.104693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fa049-3664-41fe-b915-bf7a6b17f597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.106083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fa049-3664-41fe-b915-bf7a6b17f597 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.117024 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 273/569] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:23.118243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee857af-6481-4253-b760-e275a525bf86 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.118535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee857af-6481-4253-b760-e275a525bf86 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.118852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee857af-6481-4253-b760-e275a525bf86 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.120301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 274/570] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:23.120783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee857af-6481-4253-b760-e275a525bf86 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.140387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e78a2-8da3-43f6-8a55-c5ba7b538cd6 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.173609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.174390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.174672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.175000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.185507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:23.193169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:23.194274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:23.195143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 297/571] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:23.195844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.208892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.225068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.229283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee857af-6481-4253-b760-e275a525bf86 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.262604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.263294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.263574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.263841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.264657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:23.264970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.266388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.283581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 275/572] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:23.284362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.295599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa00ea0-7c45-4473-a9f6-035003ddf179 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.328990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74fe61-14f4-43c5-bceb-4bd2384a14d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.329636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74fe61-14f4-43c5-bceb-4bd2384a14d2 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.329920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74fe61-14f4-43c5-bceb-4bd2384a14d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.330204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74fe61-14f4-43c5-bceb-4bd2384a14d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.331055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74fe61-14f4-43c5-bceb-4bd2384a14d2 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=56e635c1ca5341b2892f0c8846b280d0) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:23.331368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74fe61-14f4-43c5-bceb-4bd2384a14d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.332788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74fe61-14f4-43c5-bceb-4bd2384a14d2 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.338653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 298/573] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/role_assignments?user.id=56e635c1ca5341b2892f0c8846b280d0&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:23.340004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28747-f71b-4d4d-b950-76bf148a15ec None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.340296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28747-f71b-4d4d-b950-76bf148a15ec None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.340573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea28747-f71b-4d4d-b950-76bf148a15ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.373947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8ea28747-f71b-4d4d-b950-76bf148a15ec None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:23.375234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8ea28747-f71b-4d4d-b950-76bf148a15ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:23.391968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33255b95-b748-407b-93ae-953a6e73b253 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.432081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e621e-067a-4870-b027-165572b6b111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.432893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e621e-067a-4870-b027-165572b6b111 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.433252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e621e-067a-4870-b027-165572b6b111 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.433505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e621e-067a-4870-b027-165572b6b111 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.441496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e621e-067a-4870-b027-165572b6b111 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.443049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e621e-067a-4870-b027-165572b6b111 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.447118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.455145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 299/574] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:23.459657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28747-f71b-4d4d-b950-76bf148a15ec None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-193e621e-067a-4870-b027-165572b6b111 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:23.462065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:23.463814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:09:23.465013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:23.472777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 276/575] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:23.472777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e621e-067a-4870-b027-165572b6b111 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.498575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.579694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea28747-f71b-4d4d-b950-76bf148a15ec None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.580757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e621e-067a-4870-b027-165572b6b111 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.615229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.615424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.615900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.616096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.616194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.616358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.616457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.616638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.617285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:23.617687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.619640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.627624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.632395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 300/576] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:23.632548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.632655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:23.649879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:23.650858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:23.651736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:23.651736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:23.651736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:23.651736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:23.651736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 277/577] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:23.652009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.712428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.728691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.751928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0f2cb-65c2-4e37-9390-58f9517653ab None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.768700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7738c1-328b-4e2f-bc0a-8c8e029dc11c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.794460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.795163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.795462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.795718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.796554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:23.796868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.798377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.804035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.804828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.805117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.805388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.821460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 301/578] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:23.821652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:23.821747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:23.825963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:23.826911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:23.827740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 278/579] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:23.828431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.929231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49159f66-6680-4d5b-8cf8-c68c8abafd25 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.930108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dc304-f315-40f3-a78d-02a0563eeac9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:23.943435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:23.966608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.967296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.967578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.967853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.968582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:23.968893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.969124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:23.969908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:23.970194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:23.970288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.970470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:23.981680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:23.987736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 279/580] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:23.987871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:23.988309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:23.990017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:24.008145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:24.009033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:24.010038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:24.010038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:24.010038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:24.010038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:24.010038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 302/581] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:24.010885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.098558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a2a5-ac79-45a4-9421-d00dd1205d1e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.112529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8380c4-6323-450d-9975-3fcc58236590 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.135838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.136624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.136904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.137184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.146138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.146830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.147110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.147382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.147750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.148115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:24.148418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.149207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.149764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.158440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 303/582] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:24.159537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:24.167926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:24.168992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:24.170081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:24.170081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:24.170081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:24.170081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:24.171641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 280/583] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:24.171641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.200075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.227373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.274171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcf739-e675-4fd5-a130-b4573afd4868 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.283734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ff984-6796-435d-88f4-64575705dbdc None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.311267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.312055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.312335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.312606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.319322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.320770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.322094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.322991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.323455 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.323726 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.324439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:24.324745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.326119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:24.335216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:24.336102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:24.336990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 304/584] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:24.338840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.348884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 281/585] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:24.348884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.434345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.446608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725e5e7-7fa1-4b71-aa8a-b4dcc9fb809e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.453293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594449a9-62b9-4082-b046-442c80b03792 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.464296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.491975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.492603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.492886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.493161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.493881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:24.494750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.496136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.496527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.497801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.498852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.499342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.508336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 282/586] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:24.509138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.515562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.517042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:24.534817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:24.535892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:24.536794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:24.536794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:24.536794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:24.536794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:24.536794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 305/587] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:24.537078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.615289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c2ae-0004-4a0a-945c-835479199920 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.645891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913edaf-0d7d-471d-a937-357f611511ce None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.650512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.651407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.651894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.652351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.653308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:24.653808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.655451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.668678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 283/588] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:24.669675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.674733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.685661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.686505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.686845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.687123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.694267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.695811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:24.710611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:24.711534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 306/589] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:24.717919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.745298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.785110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeccbc-cafd-404e-b5e0-39adc3646011 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.822591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e488cc-0239-46f9-8241-7447f36e904a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.823995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.824848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.825134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.825410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.832370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.833819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:24.848126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:24.849018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:24.849888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 284/590] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:24.850394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.863762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:24.864428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:24.864712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:24.864986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:24.865698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:24.866008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:24.867405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:24.884251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 307/591] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:24.884251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:24.921657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.962515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36e15-e464-4f36-9345-1b324e332d82 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:24.972717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:24.986943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c952ce6-31a9-4684-96e5-dceb4815d2d8 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.002770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.003802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.004183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.004576 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/e40a1f11c5cd4b48be27dd1a0f48bdc9/roles/343c9b57a593491fb88af31c81cda9ed` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.019550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=e40a1f11c5cd4b48be27dd1a0f48bdc9, role_id=343c9b57a593491fb88af31c81cda9ed)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.021013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.028923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.029603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.029890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.030366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.031407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:25.031728 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.033209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.034875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 285/592] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:24 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/e40a1f11c5cd4b48be27dd1a0f48bdc9/roles/343c9b57a593491fb88af31c81cda9ed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:25.035732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.073218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 308/593] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:09:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:25.074512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.182483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438812e-0ad7-4c61-bb82-9e88a40ecf0a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.201567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:25.218831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f803c8-48b8-4cc6-8839-66b80e4e8062 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.225546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.226218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.226506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.226809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.227607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:25.227914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.229937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.243226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 286/594] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:25.243900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.263561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.264360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.264644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.264921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.272389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.273853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:25.288739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:25.289703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:25.290633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 309/595] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:25.294996 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.304072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:25.367177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b017bb2-ab94-4c3f-aaff-bc18750f43e5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.403011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8a597-a139-4eaf-8da3-f53e2e556fa7 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.405260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.406079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.406359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.406631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.417547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.419040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:25.436998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:25.437910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:25.438825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:25.438825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:25.438825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:25.438825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:25.438825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 287/596] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:25.439098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.441956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5312af1-ab71-4ae3-84ad-1489c5aac9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.442989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5312af1-ab71-4ae3-84ad-1489c5aac9d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.443266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5312af1-ab71-4ae3-84ad-1489c5aac9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.443539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5312af1-ab71-4ae3-84ad-1489c5aac9d3 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/b5eb306a63e14e57a10d468a4aa65db0/roles/343c9b57a593491fb88af31c81cda9ed` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.458976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5312af1-ab71-4ae3-84ad-1489c5aac9d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=b5eb306a63e14e57a10d468a4aa65db0, role_id=343c9b57a593491fb88af31c81cda9ed)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.460591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5312af1-ab71-4ae3-84ad-1489c5aac9d3 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.472470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:25.477388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 310/597] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:25 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/b5eb306a63e14e57a10d468a4aa65db0/roles/343c9b57a593491fb88af31c81cda9ed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:25.477388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f0fb-8bd0-4879-b2b3-1add6790fd79 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.477388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f0fb-8bd0-4879-b2b3-1add6790fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.477739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f0fb-8bd0-4879-b2b3-1add6790fd79 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.483888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 311/598] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:25.483888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634f0fb-8bd0-4879-b2b3-1add6790fd79 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.562510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:25.600875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1237e0-06dc-4951-b321-5aa55c16b70c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.626560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634f0fb-8bd0-4879-b2b3-1add6790fd79 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.648913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffff07-ff22-4a8a-b9b4-5cca090c9d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.649579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffff07-ff22-4a8a-b9b4-5cca090c9d73 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.649865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffff07-ff22-4a8a-b9b4-5cca090c9d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.650141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffff07-ff22-4a8a-b9b4-5cca090c9d73 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.651619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffff07-ff22-4a8a-b9b4-5cca090c9d73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:25.651927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffff07-ff22-4a8a-b9b4-5cca090c9d73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.653366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffff07-ff22-4a8a-b9b4-5cca090c9d73 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.670142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.671127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.671566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.671968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 288/599] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:25.672424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.673007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2c4d-1c63-4082-99e7-16eed01b756f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.673261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2c4d-1c63-4082-99e7-16eed01b756f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.673537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2c4d-1c63-4082-99e7-16eed01b756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.673800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:25.674243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.675886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.689070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 312/600] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:25.690167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.690597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-e8ab2c4d-1c63-4082-99e7-16eed01b756f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:25.692005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e8ab2c4d-1c63-4082-99e7-16eed01b756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:25.773416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 289/601] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:25.774872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2c4d-1c63-4082-99e7-16eed01b756f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.791854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:25.817845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3472d2-a7ee-4068-9cd2-aebdbe84637e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.854755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.855552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.855834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.856109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.867133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:25.875242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.877414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.893730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2c4d-1c63-4082-99e7-16eed01b756f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:25.900856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:25.901707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:25.902579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:25.902579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:25.902579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:25.902579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:25.906124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 313/602] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:25.906907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:25.940555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:25.941951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:25.942450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:25.943347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:25.951380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:25.953702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:25.973310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:25.974617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:25.975533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:25.975959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 290/603] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:25.982416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.032528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972b7c5-8ae6-4a80-ac76-f018631cf3be None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.069353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:26.077151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.078118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.078550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.078994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.091018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:26.099628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:26.100747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:26.101780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:26.104490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ccb8-ceb0-4440-880e-eed1a790189e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.109025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 314/604] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:26.109938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.141658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:26.148404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.149775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.151653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.152086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.152972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:26.153434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.154980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.171890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 291/605] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:26.173337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.231366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c284f-5d8b-4200-b69f-5c2cf76f9dee None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.276076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.277255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.278134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.278560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.279788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:26.280508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.282469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.298019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8545e4-6150-401b-8e64-3f4ab18ed509 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.303943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 315/606] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:26.303943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.340716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.341304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.341584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.341868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.342607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:26.342954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.344320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.345833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:26.358426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 292/607] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:26.359893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.424947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:26.438279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44478712-d044-42a8-a97e-9b9ffef37936 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.471707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965c20-99ea-42fc-8208-3343b0fe9ee8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.477827 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.478907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.479372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.479852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.490790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.492426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:26.507106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:26.507990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:26.508948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:26.511751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 316/608] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:26.512036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.512983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.513192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.513562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.518892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/a8c2616d20ea41f7ad4f953138f5636e/roles/343c9b57a593491fb88af31c81cda9ed` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.529728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=a8c2616d20ea41f7ad4f953138f5636e, role_id=343c9b57a593491fb88af31c81cda9ed)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.531359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.548523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 293/609] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:26 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/a8c2616d20ea41f7ad4f953138f5636e/roles/343c9b57a593491fb88af31c81cda9ed => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:26.549806 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.613560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:26.638096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6049f8-2788-4e5b-8afd-13dd5410d19f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.677221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.678275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.678525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15615d7-f404-4841-8e9f-771e3a710ab3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.678946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.679392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.692582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.694301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.704445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:26.716482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:26.717540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:26.718410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:26.718410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:26.718410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:26.718410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:26.720641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 317/610] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:26.730791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.731557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.731906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.732253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.732666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.733203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:26.733581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.735158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.749143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 294/611] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:26.755404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:26.870244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9626c1b-5cc4-4146-bf6a-5c91b11e635e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.877681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:26.891724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67f70d-416c-45ac-9550-1309d1b12c34 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:26.914928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.914928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.917006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.917006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/c11a44c395ae45fcba4e0c0fe08695c3/roles/343c9b57a593491fb88af31c81cda9ed` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.933337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=c11a44c395ae45fcba4e0c0fe08695c3, role_id=343c9b57a593491fb88af31c81cda9ed)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.934893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.936229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:26.937225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:26.937812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:26.938327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:26.939293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:26.939933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:26.941790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:26.962709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 318/613] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:26.962939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 295/613] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:26 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/c11a44c395ae45fcba4e0c0fe08695c3/roles/343c9b57a593491fb88af31c81cda9ed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:26.968031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:27.063089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:27.123307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc61cfa-a697-4f96-a6f1-e5afe79c0b5b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:27.178393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf95c5-078d-4d33-9d3f-9ffe99e4eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:27.179228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf95c5-078d-4d33-9d3f-9ffe99e4eab5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.179514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf95c5-078d-4d33-9d3f-9ffe99e4eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.179791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf95c5-078d-4d33-9d3f-9ffe99e4eab5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.194972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf95c5-078d-4d33-9d3f-9ffe99e4eab5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:27.196819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf95c5-078d-4d33-9d3f-9ffe99e4eab5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-a1cf95c5-078d-4d33-9d3f-9ffe99e4eab5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:27.212679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:27.213708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:27.214647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 319/614] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:27.222395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:27.314461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c3c83-fea0-4319-8ff8-9fb8ee3ffd61 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.314814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c3c83-fea0-4319-8ff8-9fb8ee3ffd61 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.315084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c3c83-fea0-4319-8ff8-9fb8ee3ffd61 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.316695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 320/615] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:27.322066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6421-84b5-41e7-8a61-06d141308442 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.322388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6421-84b5-41e7-8a61-06d141308442 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.322673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6421-84b5-41e7-8a61-06d141308442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.341136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4f3f6421-84b5-41e7-8a61-06d141308442 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:27.342338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4f3f6421-84b5-41e7-8a61-06d141308442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:27.351075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e13848-c758-47b8-ae22-791edd54ae23 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:27.402781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:27.403469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.403745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.404018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.404869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:27.405180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:27.406633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:27.422041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 321/616] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:27.441545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 296/617] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 30 10:09:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:27.447785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f6421-84b5-41e7-8a61-06d141308442 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:27.485198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:27.515102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:27.519047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:27.574031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f6421-84b5-41e7-8a61-06d141308442 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:27.609555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:27.610358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.610645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.610980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.621340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:27.622851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:27.640561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:27.641492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:27.642342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:27.642342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:27.642342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:27.642342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:27.642342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 322/618] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:27.648417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:27.769127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526a79-2bf6-4fc1-80ee-a59814ecb1c1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:27.779940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:27.800635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc28a5-e033-45c6-aa72-9135833577c1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:27.806363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeff947-b67a-411f-a103-73ff3f7acde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:27.807085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff947-b67a-411f-a103-73ff3f7acde1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.807361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff947-b67a-411f-a103-73ff3f7acde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.808462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeff947-b67a-411f-a103-73ff3f7acde1 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.809199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeff947-b67a-411f-a103-73ff3f7acde1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:27.809512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeff947-b67a-411f-a103-73ff3f7acde1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:27.810908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeff947-b67a-411f-a103-73ff3f7acde1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:27.830720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 323/619] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:27.830720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83945-6242-473a-942a-3f7d9f0077a0 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.830720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83945-6242-473a-942a-3f7d9f0077a0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.830720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba83945-6242-473a-942a-3f7d9f0077a0 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.830720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 324/620] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:27.830720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83945-6242-473a-942a-3f7d9f0077a0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:27.856296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb94c8-7ae4-48d2-9025-e31ae865f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:27.857527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb94c8-7ae4-48d2-9025-e31ae865f425 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.858077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb94c8-7ae4-48d2-9025-e31ae865f425 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.858545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb94c8-7ae4-48d2-9025-e31ae865f425 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.870452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb94c8-7ae4-48d2-9025-e31ae865f425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-febb94c8-7ae4-48d2-9025-e31ae865f425 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:27.878994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:27.880078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:27.880883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:27.883808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 297/621] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:27.886138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb657-2a99-4769-94da-528aa372dce5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.886603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb657-2a99-4769-94da-528aa372dce5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.887116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fb657-2a99-4769-94da-528aa372dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:27.906485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d23fb657-2a99-4769-94da-528aa372dce5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:27.908227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d23fb657-2a99-4769-94da-528aa372dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:27.950838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba83945-6242-473a-942a-3f7d9f0077a0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:27.987058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 298/622] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:27.988039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fb657-2a99-4769-94da-528aa372dce5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:27.992063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:27.992857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:27.993138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:27.993411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.001308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.003720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.004526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:28.020840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:28.021741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:28.022616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 325/623] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:28.031745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.065217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.128269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fb657-2a99-4769-94da-528aa372dce5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.157044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da703-94e2-481c-98a2-7be788eeaefc None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.164348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.165118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.165397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.165672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.166679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:28.167013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.168507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.177323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 299/624] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:28.178240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.193392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.194057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.194340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.194615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.195548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:28.195862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.198367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.211419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 326/625] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:28.212316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.255029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.292367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5a5c2-44a4-40a1-b4ca-7b191292f023 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.300570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.320156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1835abe-62b9-4235-892f-1930a3eb6b45 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.331295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.332087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.332366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.332638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.349446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:28.357414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:28.358659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:28.359558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:28.363750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 300/626] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:28.364706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.365161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.366178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.366602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.367081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.386154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.388561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:28.412771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:28.414817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:28.416060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:28.416060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:28.416060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:28.416060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:28.424097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 327/627] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:28.424097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.513689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f34576-ac79-484e-b9a8-e9f876dfcde1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.540060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc204c5-bb51-4bcc-93a3-911e38763a5d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.549129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.562002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.563964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.564401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.564822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/56e635c1ca5341b2892f0c8846b280d0/roles/343c9b57a593491fb88af31c81cda9ed` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.577643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.578473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.578857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.579215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.580100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:28.580495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.581948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.583605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.585814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=56e635c1ca5341b2892f0c8846b280d0, role_id=343c9b57a593491fb88af31c81cda9ed)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.587530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.596860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 328/628] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:28.597802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.607799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 301/629] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:28 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/56e635c1ca5341b2892f0c8846b280d0/roles/343c9b57a593491fb88af31c81cda9ed => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:28.608978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.738554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aecc38-8e88-4a8e-9052-25f287b0a9e5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.783071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.784183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.784614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.785034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.799315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.801198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:28.823717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:28.824818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:28.825914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:28.825914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:28.825914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:28.825914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:28.828062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 302/630] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:28.833073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.835846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5288cb-b18d-4c46-83a0-3f110f8944e1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.871262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:28.877196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:28.877950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:28.878302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:28.878587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:28.879353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:28.879665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:28.881036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:28.898376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 329/631] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:28.899354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:28.961799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571196e5-7fc5-4c54-bb0c-4ab74da84004 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:28.983331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.001215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.002237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.002793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.003330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.004407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:29.004916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:29.006642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:29.020006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 303/632] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:29.024892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.053919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eb85b-da75-4053-a7fa-8e5b513eb368 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.114628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f10877-e1ac-4ed4-8423-6bfe61e72d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.115452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10877-e1ac-4ed4-8423-6bfe61e72d57 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.115808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10877-e1ac-4ed4-8423-6bfe61e72d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.116092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10877-e1ac-4ed4-8423-6bfe61e72d57 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.126456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f10877-e1ac-4ed4-8423-6bfe61e72d57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:29.128194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f10877-e1ac-4ed4-8423-6bfe61e72d57 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:29.129172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-93f10877-e1ac-4ed4-8423-6bfe61e72d57 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:29.143749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:29.144745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:29.146346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 330/633] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:29.146968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e5b7-820e-46e4-8165-2e165f1de5fd None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.146968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e5b7-820e-46e4-8165-2e165f1de5fd None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.147288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e5b7-820e-46e4-8165-2e165f1de5fd None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.150781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cbbf4-aa39-498d-afed-58e3030ad11d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.152872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 331/634] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:29.153654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e5b7-820e-46e4-8165-2e165f1de5fd None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.188097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb24a6-2ba8-4d6c-bf38-a1ffc1138ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.189359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb24a6-2ba8-4d6c-bf38-a1ffc1138ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.189848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb24a6-2ba8-4d6c-bf38-a1ffc1138ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.190350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb24a6-2ba8-4d6c-bf38-a1ffc1138ab1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.199773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb24a6-2ba8-4d6c-bf38-a1ffc1138ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:29.201648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb24a6-2ba8-4d6c-bf38-a1ffc1138ab1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-dceb24a6-2ba8-4d6c-bf38-a1ffc1138ab1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:29.219088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:29.220043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:09:29.220974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:29.223734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 304/635] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:29.225243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bed7-a5c0-48bb-a85c-81f09e83f3b0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.225820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bed7-a5c0-48bb-a85c-81f09e83f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.226272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45bed7-a5c0-48bb-a85c-81f09e83f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.243812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8e45bed7-a5c0-48bb-a85c-81f09e83f3b0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:29.245235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8e45bed7-a5c0-48bb-a85c-81f09e83f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:29.281700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e5b7-820e-46e4-8165-2e165f1de5fd None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.299518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.321662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 305/636] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:29.323832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bed7-a5c0-48bb-a85c-81f09e83f3b0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.333095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45341d05-36ba-4927-8565-700e018442dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.333874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45341d05-36ba-4927-8565-700e018442dc None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.334161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45341d05-36ba-4927-8565-700e018442dc None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.334439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45341d05-36ba-4927-8565-700e018442dc None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.335404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45341d05-36ba-4927-8565-700e018442dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:29.335858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45341d05-36ba-4927-8565-700e018442dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:29.337516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45341d05-36ba-4927-8565-700e018442dc None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:29.357353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 332/637] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:29.358508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0a3af-2272-4b3d-b557-9670c5770cbb None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.363039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0a3af-2272-4b3d-b557-9670c5770cbb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.363351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0a3af-2272-4b3d-b557-9670c5770cbb None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.364809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 333/638] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:29.365399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0a3af-2272-4b3d-b557-9670c5770cbb None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.409083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.433410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45bed7-a5c0-48bb-a85c-81f09e83f3b0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.468777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.469449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.469732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.470014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.470886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:29.471223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:29.472655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:29.474332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0a3af-2272-4b3d-b557-9670c5770cbb None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.498397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 306/639] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:29.499287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.518843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7efbc-4555-4038-b411-60ef8e76e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.519645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7efbc-4555-4038-b411-60ef8e76e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.519937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7efbc-4555-4038-b411-60ef8e76e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.520217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7efbc-4555-4038-b411-60ef8e76e4d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.533309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7efbc-4555-4038-b411-60ef8e76e4d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-0fa7efbc-4555-4038-b411-60ef8e76e4d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:29.541212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:29.546923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 334/640] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:29.547770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42863bd9-f4fd-4227-a5b0-71c6ad0590df None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.548502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42863bd9-f4fd-4227-a5b0-71c6ad0590df None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.548502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42863bd9-f4fd-4227-a5b0-71c6ad0590df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.561141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-42863bd9-f4fd-4227-a5b0-71c6ad0590df None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:29.562354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-42863bd9-f4fd-4227-a5b0-71c6ad0590df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:29.589925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.620641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f58ab-9108-4180-bd27-c97382984c2d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.632364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 335/641] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:29.633157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42863bd9-f4fd-4227-a5b0-71c6ad0590df None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.663866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.664516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.664799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.665074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.669390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.737011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42863bd9-f4fd-4227-a5b0-71c6ad0590df None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.739144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:29.740808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:29.773505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.774268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.774550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.774854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:29.806153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.839629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 307/642] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:29.840524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.851572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:29.853072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:29.876301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:29.958637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623799-9bdf-40a7-bbfb-0ac52da1427b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:29.960501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 336/643] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:29.965687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:29.998209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:29.998915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:29.999197 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:29.999705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.000213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:30.000545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.001892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.014368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 308/644] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:30.014368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.036564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.079733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75248307-0a6d-4ced-a36e-94e50378aedf None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.114650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.115649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.116186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.116354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.116968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.120635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1d9c-ba7d-461a-951f-9a3242eeeab7 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.130065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:30.138293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:30.139521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:30.140385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 337/645] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:30.141107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.159607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.160531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.160881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.161224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.173108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.174745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:30.192537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:30.193478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:30.194507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:30.194507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:30.194507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.194507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:30.194507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 309/646] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:30.194846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.256003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d485b7-f7c2-4b28-a46e-37fa3e38adc9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.280134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.294578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.295472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.295761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.296039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.296973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849b02-6be9-48b3-a90a-64b1253decd8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.307117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.309071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:30.326589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:30.327530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:30.328432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:30.328432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:30.328432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.328432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:30.328432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 338/647] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:30.328727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.336329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.338224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.338731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.339209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.351662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.353407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:30.372146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:30.373061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:30.373979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:30.373979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:30.373979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.373979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:30.373979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 310/648] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:30.376029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.380652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.439109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1fc0-47ab-42a4-be73-cd94869206f6 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.482072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.483020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.483701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.483983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.485342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:30.485748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.487211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.491546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb8729-68f8-4ab1-9176-973960c536ec None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.496501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 339/649] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:30.497130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.533279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.533947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.534234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.534513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.535270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:30.535584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.536961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.537347 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.550756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 311/650] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:30.555648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.600787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f2c40-36d0-44db-bd16-f52c4651f3b6 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.621874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.637701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.638297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.638576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.638878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.639878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:30.640186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.641550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.654761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 340/651] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:30.655653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.668760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf58a51-a0b5-459c-8708-c02be1392367 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.709677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.710335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.710619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.710924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.711649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:30.711957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.713364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.730371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 312/652] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:30.730371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.760764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.765684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39839db1-7bae-475f-9aee-2b9210692c87 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.803594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.804138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.804424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.804749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.815702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.817064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:30.835042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:30.835950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:30.836822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:30.836822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:30.836822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:30.836822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:30.836822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 341/653] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:30.837110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.844668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd6bfb-5339-4e32-a37e-a44b42b41522 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.870247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:30.884039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.884886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.885264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.885534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.892794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.894190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:30.910051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:30.911215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 313/654] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:30.912131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:30.938723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db3cd3-b263-40aa-8437-8943f913a04e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:30.973196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:30.973979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:30.974262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:30.974536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:30.981650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:30.983134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:30.997083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:30.998052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:30.998979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 342/655] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:30.999460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.012141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.012998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2eb76-b4e8-4fc7-8c03-2b42b08b4b59 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.048042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3516-76f8-4882-a410-f291966be6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.048833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3516-76f8-4882-a410-f291966be6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.049113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3516-76f8-4882-a410-f291966be6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.049385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3516-76f8-4882-a410-f291966be6f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.056462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3516-76f8-4882-a410-f291966be6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.058468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3516-76f8-4882-a410-f291966be6f9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-525d3516-76f8-4882-a410-f291966be6f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:31.072905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:31.074052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:31.075475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 314/656] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:31.076090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfe72-8617-42b8-b6bf-d758bd558245 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.076090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfe72-8617-42b8-b6bf-d758bd558245 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.076218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfe72-8617-42b8-b6bf-d758bd558245 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.081616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 315/657] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:31.081616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfe72-8617-42b8-b6bf-d758bd558245 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.104293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1264e-a9a7-480f-9cdc-a3304a5e2dfc None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.128033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.137510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.138400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.138532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.138740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.139462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:31.139769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.141128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.153205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 343/658] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:31.153983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.186939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfe72-8617-42b8-b6bf-d758bd558245 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.220490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.221137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.221412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.221681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.222318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.222443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:31.222781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.224280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.236169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 316/659] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:31.236939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.254186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ebb16-7c73-4d93-a59c-3b9df377bbc3 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.288354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c8dd4-2cee-4695-bf7b-178da76bcd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.289005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c8dd4-2cee-4695-bf7b-178da76bcd70 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.289292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c8dd4-2cee-4695-bf7b-178da76bcd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.289568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c8dd4-2cee-4695-bf7b-178da76bcd70 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.290350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c8dd4-2cee-4695-bf7b-178da76bcd70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:31.290665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c8dd4-2cee-4695-bf7b-178da76bcd70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.292670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c8dd4-2cee-4695-bf7b-178da76bcd70 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.303784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 344/660] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:31.304953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f022-b9b1-45df-a74b-19fc141705b0 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.305238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f022-b9b1-45df-a74b-19fc141705b0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.305517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f022-b9b1-45df-a74b-19fc141705b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.321848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b025f022-b9b1-45df-a74b-19fc141705b0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:31.323592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b025f022-b9b1-45df-a74b-19fc141705b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:31.335575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beeeca1-c0e3-4ed8-832f-3542883abf11 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.337125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.372307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.372970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.373259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.373533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.374371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:31.374702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.376147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.391756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 345/661] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:31.392592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f022-b9b1-45df-a74b-19fc141705b0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.398730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 317/662] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:31.398730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.457692 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.499207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f022-b9b1-45df-a74b-19fc141705b0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.505416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c1a1-29e5-4bc1-b237-54c68ace1aa5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.532935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.533724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.534010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.534294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.538837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.539484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.539767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.540049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.541383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=e40a1f11c5cd4b48be27dd1a0f48bdc9) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:31.541693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.541791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.543175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.543302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.549446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 318/663] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/role_assignments?user.id=e40a1f11c5cd4b48be27dd1a0f48bdc9&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:31.550221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:31.558960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:31.560069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 10:09:31.561005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:31.561546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 346/664] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:31.562864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.578480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.666646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c2f60-f54f-45ae-a7a9-cd82a6db56f1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.680102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27606f1-fb68-4209-9296-5d6bdd638c33 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.705847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.706433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.707058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.707379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.707678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.708708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=b5eb306a63e14e57a10d468a4aa65db0) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:31.708972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.710424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.717929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 319/665] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/role_assignments?user.id=b5eb306a63e14e57a10d468a4aa65db0&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:31.718768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.729538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.730208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.730496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.731925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.822935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:31.824592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:31.848770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:31.871702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c4989-1bf3-4e1d-9ea4-20de31bc2aeb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:31.920847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:31.921248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:31.921530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:31.921811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:31.938110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:31.948296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:31.949404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:31.950414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 320/666] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:31.951258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.970933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 347/667] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:31.971737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:31.996406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:32.082805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43015-36ad-4b0b-9cbf-60b2f882b6c0 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.093988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d930fd-aae5-4a85-80fe-2d1f231634c7 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.125115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.126382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.126820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.127106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.128120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:32.128435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.130536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.134057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.134932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.135322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.135727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.136700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:32.137080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.138610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.139562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 348/668] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:32.140771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.159577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 321/669] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 30 10:09:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:32.160903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.170678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:32.250189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:32.274491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616667b-c977-49b3-872a-5cd3c1846952 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.276078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1038-389a-420c-8050-656ac8f8c31a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.316295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.317093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.317287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.317422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.317637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.318477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.318927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.319382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.331309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.331576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.333075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.333386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:32.352346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:32.353709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:32.354600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:32.354600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:32.354600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:32.354600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:32.354861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:32.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:32.356537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:32.356537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:32.356537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:32.356537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:32.359046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 322/671] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:32.359166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 349/671] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:32.360028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.361591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.423657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:32.476640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290426f-02bb-4f4e-910e-794cfb80d858 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.495862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067a09-40a0-439e-93f9-7ca5d59e299f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.523519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.524117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.524403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.524686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.526234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:32.526554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.528680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.535020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.535900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.536375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.536829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.540047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:32.549425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 323/672] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:32.550480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.614067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.615944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.693062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f047-9e7b-4180-a801-eb446d808304 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.711988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:32.732540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.733556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.734053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.734525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.735485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:32.736027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.737665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.741682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 350/673] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:32.742671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.752768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 324/674] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:32.753850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.792248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:32.865442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7630e0-c001-413c-af7e-2b0f46c5cd79 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.874788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5a0b8-9f4e-407c-9769-d94ca50cc00e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:32.905163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.906005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.906282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.906787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.914161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:32.915480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:32.916038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:32.916569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:32.917764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.919317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.925808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:32.927763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:32.938821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:32.939722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:32.940591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:32.940591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:32.940591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:32.940591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:32.944623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 325/675] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:32.945448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:32.946355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:32.947792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:32.948654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:32.951128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 351/676] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:32.952126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:32.982381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.056461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.058558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26166edf-736e-40ca-850a-9b933c78b0bb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.065423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dcf1a-82e3-4a91-86b5-f5aa88e0fd6e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.095000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.095871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.096053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.096316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.103626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.105070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.105907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.106961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.107543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.108013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.108998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:33.109513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.111123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:33.119346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:33.120279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:33.121209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 326/677] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:33.121807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.126942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 352/678] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:33.127925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.219847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.229942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b539f-27e5-4615-b698-12bbc60334bb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.237807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c89aa-641c-4ff1-9e20-b5368a8e52f2 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.265823 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.266665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.267091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.267454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.268558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:33.268721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.270267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.277344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.278302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.278765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.279208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.280414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:33.280935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.282541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.284000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 327/679] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:33.284903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.303168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 353/680] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:33.304483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.320171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.389678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da12340-65da-480f-a843-39032a9b05bd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.416964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45379d7c-5917-4093-a29c-9b1e1c81ff3d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.424016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.424873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.425153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.425460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.433256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.434732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:33.450891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:33.451886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:33.452769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:33.456833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 328/681] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:33.457709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.461342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.462255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.462798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.463290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.464315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=a8c2616d20ea41f7ad4f953138f5636e) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:33.464823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.466544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.470470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.477781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 354/682] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/role_assignments?user.id=a8c2616d20ea41f7ad4f953138f5636e&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:33.479478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.571630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d40dc-bddf-48bf-9bcf-061ba959883d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.574634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.602943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a6346-6ac9-42e3-a7a3-0046d6d44f39 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.609706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee57f-44ad-4546-baa0-3cd3f13b30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.610377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee57f-44ad-4546-baa0-3cd3f13b30cd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.610653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee57f-44ad-4546-baa0-3cd3f13b30cd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.610957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee57f-44ad-4546-baa0-3cd3f13b30cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.674890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.675603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.675888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.676161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.676954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:33.677268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.678705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.707947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 355/683] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:33.714138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.744608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee57f-44ad-4546-baa0-3cd3f13b30cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.746076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee57f-44ad-4546-baa0-3cd3f13b30cd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.758497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.848155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbcffc-d763-480f-9a00-0b71572aa925 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:33.869772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 329/684] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:33.871580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468333cf-8e41-4d9f-97ad-d00471bd7fd9 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.872070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468333cf-8e41-4d9f-97ad-d00471bd7fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.872528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468333cf-8e41-4d9f-97ad-d00471bd7fd9 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.874892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 330/685] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:33.875621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468333cf-8e41-4d9f-97ad-d00471bd7fd9 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:33.888753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8825-ebce-4e25-b4a7-62f3a12a6805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:33.889402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8825-ebce-4e25-b4a7-62f3a12a6805 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.889708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8825-ebce-4e25-b4a7-62f3a12a6805 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.889981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8825-ebce-4e25-b4a7-62f3a12a6805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8825-ebce-4e25-b4a7-62f3a12a6805 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=c11a44c395ae45fcba4e0c0fe08695c3) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:33.891171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8825-ebce-4e25-b4a7-62f3a12a6805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:33.892578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8825-ebce-4e25-b4a7-62f3a12a6805 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:33.897834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:33.902260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 356/686] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/role_assignments?user.id=c11a44c395ae45fcba4e0c0fe08695c3&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:33.903539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c7523-da3e-431f-a5ca-dee4676a049a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:33.904114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c7523-da3e-431f-a5ca-dee4676a049a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:33.904735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c7523-da3e-431f-a5ca-dee4676a049a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:33.926994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-644c7523-da3e-431f-a5ca-dee4676a049a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:33.928354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-644c7523-da3e-431f-a5ca-dee4676a049a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:34.022751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 357/687] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:34.024220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8ed28-24fe-4766-ace1-f7aa158d292f None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.024513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8ed28-24fe-4766-ace1-f7aa158d292f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.024791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8ed28-24fe-4766-ace1-f7aa158d292f None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.026263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 358/688] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:34.030373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468333cf-8e41-4d9f-97ad-d00471bd7fd9 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.032653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b1bb-3d9a-4689-a43c-560e959bffa0 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.032936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b1bb-3d9a-4689-a43c-560e959bffa0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.033211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820b1bb-3d9a-4689-a43c-560e959bffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.056338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.068562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2820b1bb-3d9a-4689-a43c-560e959bffa0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:34.070784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2820b1bb-3d9a-4689-a43c-560e959bffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:34.088170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.089201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.089495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.089895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.104396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.105803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:34.126791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:34.127714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:34.128597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:34.128597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:34.128597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:34.128597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:34.128597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 331/689] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:34.129408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.184993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 359/690] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:34.186989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b1bb-3d9a-4689-a43c-560e959bffa0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.257590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205365c9-035d-45cd-bf7e-ef7285f7905c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.276253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.306017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.307307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.307686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.308490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.322987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.324374 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820b1bb-3d9a-4689-a43c-560e959bffa0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.324696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:34.348958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:34.350078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:34.351111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:34.351111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:34.351111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:34.351111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:34.354939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 332/691] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:34.356063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.373193 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.374103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.374547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.374849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.375837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.376915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:34.377734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.379056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.396085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 360/692] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:34.396976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.473747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcc62e-dca9-4fbb-a315-a9e9dd6e67ed None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.511385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.512562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.513070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.513565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.514467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.515790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced820b4-5666-4b9e-b6c8-7eca85700fc1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.516343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.537315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:34.539857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:34.540943 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:34.541789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:34.544812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 333/693] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:34.546100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.555743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.557084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.557472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.557856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.558771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:34.559179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.561365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.576150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 361/694] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:34.577700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.639243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.663131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdf7bd-3604-47a2-9d1e-557a7cfaa693 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.686516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9e915-10da-4aca-9fc5-6b1332802de0 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.700496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.701412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.701837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.702212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.709663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.711440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.724962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.725851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.726279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.726715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.727561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:34.727701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:34.728678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:34.729552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:34.730532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.732099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.734517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 334/695] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:34.735430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.742118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 362/696] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:34.743207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.791749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.843578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a572f-652e-4a86-9194-fdaeb7af21e6 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.850943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607929-1a39-4ae9-87e6-996eea00692a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:34.879090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.879896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.880259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.880589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.881549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.882891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.890283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:34.891295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:34.891760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:34.892439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:34.892694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:34.894050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:34.894566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:34.896714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:34.911850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 335/697] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:09:34 2022] POST /identity/v3/users => generated 254 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:34.913071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:34.920786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 363/698] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:34.923311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:35.062888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababa416-2ee6-41c3-b427-1b2975710206 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:35.105370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8942978-7bc4-4e85-8f0b-bff44cbba45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:35.106399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8942978-7bc4-4e85-8f0b-bff44cbba45d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:35.106990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8942978-7bc4-4e85-8f0b-bff44cbba45d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:35.107488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8942978-7bc4-4e85-8f0b-bff44cbba45d None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:35.108551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8942978-7bc4-4e85-8f0b-bff44cbba45d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:35.109090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8942978-7bc4-4e85-8f0b-bff44cbba45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:35.110796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8942978-7bc4-4e85-8f0b-bff44cbba45d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:35.117744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 336/699] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:35.133088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbf486-8174-49bc-8900-f3f7dd2fec7b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:35.146074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:35.190837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f39306-8bf9-4386-8ae2-1e971889ba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:35.191624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39306-8bf9-4386-8ae2-1e971889ba79 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:35.191910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39306-8bf9-4386-8ae2-1e971889ba79 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:35.192185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39306-8bf9-4386-8ae2-1e971889ba79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:35.193054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f39306-8bf9-4386-8ae2-1e971889ba79 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=56e635c1ca5341b2892f0c8846b280d0) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:35.194115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f39306-8bf9-4386-8ae2-1e971889ba79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:35.195837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f39306-8bf9-4386-8ae2-1e971889ba79 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:35.210520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 364/700] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:34 2022] GET /identity/v3/role_assignments?user.id=56e635c1ca5341b2892f0c8846b280d0&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:35.883689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5492b8d-07a9-4683-8d77-475cabc0c1da None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:35.884179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5492b8d-07a9-4683-8d77-475cabc0c1da None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:35.884179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5492b8d-07a9-4683-8d77-475cabc0c1da None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:35.885805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 337/701] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:35.891516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797264a-ec44-4990-bdf7-80ae514d0bef None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:35.891969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797264a-ec44-4990-bdf7-80ae514d0bef None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:35.892050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797264a-ec44-4990-bdf7-80ae514d0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:35.915671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-0797264a-ec44-4990-bdf7-80ae514d0bef None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:35.917780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0797264a-ec44-4990-bdf7-80ae514d0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:36.004304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 365/702] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 10:09:36.035997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5492b8d-07a9-4683-8d77-475cabc0c1da None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:36.119404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:36.192419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5492b8d-07a9-4683-8d77-475cabc0c1da None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:36.238234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acd389-7abf-4492-b9de-bb5dacad4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:36.239061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd389-7abf-4492-b9de-bb5dacad4c72 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:36.239344 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd389-7abf-4492-b9de-bb5dacad4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:36.239624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acd389-7abf-4492-b9de-bb5dacad4c72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:36.254096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acd389-7abf-4492-b9de-bb5dacad4c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-90acd389-7abf-4492-b9de-bb5dacad4c72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:36.262251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:36.263230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:36.264631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 338/703] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:36.269246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797264a-ec44-4990-bdf7-80ae514d0bef None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:36.363635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774761e-1f6b-4b4f-bf1b-540f3efc8f22 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:36.363956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774761e-1f6b-4b4f-bf1b-540f3efc8f22 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:36.364207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774761e-1f6b-4b4f-bf1b-540f3efc8f22 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:36.365711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 339/704] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:36.373192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10cec0-5437-4b70-88f6-967c720f0b64 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:36.373483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10cec0-5437-4b70-88f6-967c720f0b64 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:36.373760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10cec0-5437-4b70-88f6-967c720f0b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:36.404404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-cb10cec0-5437-4b70-88f6-967c720f0b64 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:36.405688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cb10cec0-5437-4b70-88f6-967c720f0b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:36.442901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:36.447990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797264a-ec44-4990-bdf7-80ae514d0bef None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:36.520721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:36.520721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:36.520721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:36.520721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:36.521172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:36.521172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:36.521172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:36.524088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 340/705] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:36.528980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 366/706] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:36.534042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10cec0-5437-4b70-88f6-967c720f0b64 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:36.576664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:36.601446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:36.655749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10cec0-5437-4b70-88f6-967c720f0b64 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:36.695946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:36.697815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:36.698472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:36.699013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:36.719942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:36.721680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:36.750598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:36.751501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:36.752380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:36.752380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:36.752380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:36.752380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:36.757826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 341/707] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:36.763883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:36.769486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d2ff8-b26b-4248-9874-15a96f930f6a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:36.819318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:36.821472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:36.822543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:36.823091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] PATH_INFO: `/v3/services/network` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:36.823945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:36.825552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:36.841685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:36.842666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:36.843527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:36.846643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 367/708] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:36 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:36.852631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:36.883406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:36.953291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:36.956438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4872f-325f-48ba-8257-1fca95f01545 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:37.022784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:37.023460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.023750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.024022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.024750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:37.025058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:37.026490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:37.046350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 342/709] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:37.051699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:37.053169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe2da3-08e3-480d-9f1b-30e1a855724c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:37.129001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:37.129677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.129963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.130244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.130989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] RBAC: Adding query filter params (name=network) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:37.131299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:37.135831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:37.144679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 368/710] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:09:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:37.153476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:37.225692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15605-d67a-4bec-8b67-6760bf217a15 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:37.262438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:37.263553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.263666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.263903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.272369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:37.274295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:37.290676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:37.291673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:37.293072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 343/711] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:09:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:37.297294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:37.335062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:37.337877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:37.363182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b401155-5451-41bc-88f6-8754ae4ceb27 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:37.426973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a3fd1-96e2-4d7b-8284-d6e7fcdd5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:37.427636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3fd1-96e2-4d7b-8284-d6e7fcdd5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.427914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3fd1-96e2-4d7b-8284-d6e7fcdd5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.428186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a3fd1-96e2-4d7b-8284-d6e7fcdd5fe1 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.428891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a3fd1-96e2-4d7b-8284-d6e7fcdd5fe1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:37.429194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a3fd1-96e2-4d7b-8284-d6e7fcdd5fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:37.430557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a3fd1-96e2-4d7b-8284-d6e7fcdd5fe1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:37.451103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 369/712] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:09:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:37.464659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd37a8-e93b-44e1-9463-3d63886a2ff5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:37.493642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1815c-b09e-4e61-b2b9-d616733e9c86 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.494722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1815c-b09e-4e61-b2b9-d616733e9c86 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.494906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1815c-b09e-4e61-b2b9-d616733e9c86 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.496981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 370/713] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:37.502839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519a6c-4678-4f71-85b5-73d36c387695 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.503477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519a6c-4678-4f71-85b5-73d36c387695 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.503945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12519a6c-4678-4f71-85b5-73d36c387695 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.505993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 371/714] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:37.507547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e97c2-0e49-4daf-bc29-bfb1029a3056 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.508135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e97c2-0e49-4daf-bc29-bfb1029a3056 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.508629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e97c2-0e49-4daf-bc29-bfb1029a3056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.529093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e37e97c2-0e49-4daf-bc29-bfb1029a3056 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:37.530748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e37e97c2-0e49-4daf-bc29-bfb1029a3056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:37.535422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056e62e-1431-40e2-aadf-26e7503268bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:37.536107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e62e-1431-40e2-aadf-26e7503268bf None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.536387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e62e-1431-40e2-aadf-26e7503268bf None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.536686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056e62e-1431-40e2-aadf-26e7503268bf None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.537546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056e62e-1431-40e2-aadf-26e7503268bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:37.537860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056e62e-1431-40e2-aadf-26e7503268bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:37.539395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056e62e-1431-40e2-aadf-26e7503268bf None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:37.561647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 344/715] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:09:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:37.563106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d6e9-f842-4090-b06c-1644759f9e19 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.563391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d6e9-f842-4090-b06c-1644759f9e19 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.563665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41d6e9-f842-4090-b06c-1644759f9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.583106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5f41d6e9-f842-4090-b06c-1644759f9e19 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:37.584431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5f41d6e9-f842-4090-b06c-1644759f9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:37.631230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 372/716] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:37.632447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e97c2-0e49-4daf-bc29-bfb1029a3056 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:37.663900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 345/717] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:37.670710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41d6e9-f842-4090-b06c-1644759f9e19 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:37.678118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:37.742632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:37.764801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e97c2-0e49-4daf-bc29-bfb1029a3056 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:37.800863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41d6e9-f842-4090-b06c-1644759f9e19 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:37.801787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:37.802713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.803203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.803680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.847458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:37.848261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:37.848542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:37.848819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:37.863104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:37.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:37.875226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:37.876156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 346/718] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:37.876879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:37.885424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:37.887293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:37.956090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:37.974764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:38.006564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186160d-eef1-4cc8-88a4-e1460fa898da None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.008768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 373/719] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:38.009711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.055689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.056388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.056673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.056946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.057662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:38.059078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:38.075123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 347/720] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:09:37 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:38.075983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.133009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300de1-d437-4ab8-b122-8e01dd8d9b02 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.186741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3210-737f-4a9d-a141-d4cc5eff4335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.188285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3210-737f-4a9d-a141-d4cc5eff4335 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.188578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3210-737f-4a9d-a141-d4cc5eff4335 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.188924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3210-737f-4a9d-a141-d4cc5eff4335 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.190129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3210-737f-4a9d-a141-d4cc5eff4335 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:38.190455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3210-737f-4a9d-a141-d4cc5eff4335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:38.192182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3210-737f-4a9d-a141-d4cc5eff4335 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:38.206401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 374/721] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:38.208255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd37ed9-8703-4f52-ae78-a67fdab5da5b None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.208548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd37ed9-8703-4f52-ae78-a67fdab5da5b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.208830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd37ed9-8703-4f52-ae78-a67fdab5da5b None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.211643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 375/722] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:38.212429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd37ed9-8703-4f52-ae78-a67fdab5da5b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.214900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469fb0d-82fa-4695-b95a-69abd0df0165 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.252062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:38.265155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb91607-00be-4b05-a53b-b59596af51f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.265881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91607-00be-4b05-a53b-b59596af51f9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.266163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91607-00be-4b05-a53b-b59596af51f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.266437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb91607-00be-4b05-a53b-b59596af51f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.269406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:38.286940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb91607-00be-4b05-a53b-b59596af51f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:38.288389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb91607-00be-4b05-a53b-b59596af51f9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-4cb91607-00be-4b05-a53b-b59596af51f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:38.309942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:38.310970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:38.311850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:38.311850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:38.311850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:38.311850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:38.311850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 348/723] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:38.313014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c559ca-6d39-4c83-a339-9e5eabec3535 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.313014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c559ca-6d39-4c83-a339-9e5eabec3535 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.313263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c559ca-6d39-4c83-a339-9e5eabec3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.340832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-41c559ca-6d39-4c83-a339-9e5eabec3535 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:38.343188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-41c559ca-6d39-4c83-a339-9e5eabec3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:38.345905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd37ed9-8703-4f52-ae78-a67fdab5da5b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.382550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.383480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.383839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.384403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.396074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:38.397936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:38.416977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:38.417910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:38.418816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:38.418816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:38.418816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:38.418816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:38.418816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 376/724] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:38.423762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.432613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 349/725] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:38.440891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c559ca-6d39-4c83-a339-9e5eabec3535 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.559471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c559ca-6d39-4c83-a339-9e5eabec3535 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.565377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:38.574901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:38.582237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ac321-b672-4159-88c7-cbbb7c8b6067 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.612429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.613682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.614430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.614927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.616844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:38.617375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:38.619415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:38.621366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.622272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.622797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.623461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.624397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:38.624928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:38.626510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:38.633424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 350/726] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:38.634278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.650018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 377/727] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:38.651319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.767935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a5876-aa2d-47f6-b3d0-8df1b81946ae None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.773753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a8cad-9968-4a8d-ad34-88bc1df0f59b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.808373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.809582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.810091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.810581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.816981 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.817795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.818224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.818617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.819339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:38.821005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:38.831752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:38.838631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:38.839567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:38.840511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:38.841043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:38.841900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 351/728] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:38.842777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.850164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 378/729] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:38.851362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:38.867274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:38.878975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:38.955948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288dee-d90b-4640-a7ce-e7a4c86cbebc None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.960163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80666fd-fa24-45ee-bc71-0a2fdaa4154a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:38.991487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.992269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.992791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.992903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:38.997971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:38.998917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:38.999413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:38.999897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.000481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.001083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:39.001594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.001950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.003465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.013093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 379/730] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:39.014132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:39.017042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:39.017917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:39.018845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:39.022824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 352/731] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:39.023665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.100254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.119646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.130275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f47b5-1c60-4cdf-ab39-c7bce29fef26 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.131686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445452f-7a1d-40b4-9f1c-7e75e568c71f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.168389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.169037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.169485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.169485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.169762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.170619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.171144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.171623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.172740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:39.173311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.174964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.180495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.182004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.194634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 380/732] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:39.200026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:39.201745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:39.202598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:39.203528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:39.203528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:39.203528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:39.203528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:39.203528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 353/733] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:39.203810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.312082 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf039-bde0-4370-9eee-1085b1135ff0 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.312459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e50b8-c950-47ab-af9c-5b13f761c9db None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.345290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.350149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6f581-0f6e-4503-bb5f-e2ca72c90bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.350995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6f581-0f6e-4503-bb5f-e2ca72c90bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.351231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6f581-0f6e-4503-bb5f-e2ca72c90bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.351517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6f581-0f6e-4503-bb5f-e2ca72c90bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.353541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.354427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.354972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.355453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.356441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:39.356956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.358626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.364272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.372823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 381/734] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:39.373909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.450961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6f581-0f6e-4503-bb5f-e2ca72c90bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.453390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6f581-0f6e-4503-bb5f-e2ca72c90bb2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.522439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09ff5f-8bf1-4835-8ff2-6f858da6d07f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.560518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.561426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.561714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.561988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.562727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:39.563041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.564417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.582058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 382/735] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:39.582058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.591137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 354/736] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 10:09:39.593355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abe267-3834-4b56-b306-42a6df9baa83 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.593811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abe267-3834-4b56-b306-42a6df9baa83 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.594247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abe267-3834-4b56-b306-42a6df9baa83 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.600512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 355/737] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:39.601476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abe267-3834-4b56-b306-42a6df9baa83 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.636031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.651801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.682900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735111a1-99ac-4625-8466-5137c4a47d4a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.715703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abe267-3834-4b56-b306-42a6df9baa83 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.718001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.718659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.718976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.719260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.720088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=a8c2616d20ea41f7ad4f953138f5636e) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:39.720404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.721833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.734719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 383/738] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/role_assignments?user.id=a8c2616d20ea41f7ad4f953138f5636e&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:39.734719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.764223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5466f-e979-4c81-ad4e-a8b80765cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.765834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5466f-e979-4c81-ad4e-a8b80765cc27 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.766128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5466f-e979-4c81-ad4e-a8b80765cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.766409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5466f-e979-4c81-ad4e-a8b80765cc27 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.777991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5466f-e979-4c81-ad4e-a8b80765cc27 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.779565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5466f-e979-4c81-ad4e-a8b80765cc27 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-45c5466f-e979-4c81-ad4e-a8b80765cc27 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:39.799255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:39.800277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:39.801217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 356/739] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:39.802407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd947-3416-4d87-971f-448b3ae84940 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.802930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd947-3416-4d87-971f-448b3ae84940 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.806714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd947-3416-4d87-971f-448b3ae84940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.824760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-034bd947-3416-4d87-971f-448b3ae84940 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:39.826965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-034bd947-3416-4d87-971f-448b3ae84940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:39.868500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98f72b-2362-4f76-95ff-ca05fee458ec None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:39.891753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.923199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:39.924378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:39.924838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:39.925259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:39.925456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 357/740] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 10:09:39.926664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bd947-3416-4d87-971f-448b3ae84940 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:39.939854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:39.941842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:39.959724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:39.969336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:39.970479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:39.971640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:39.971640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:39.971640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:39.971640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:39.974048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 384/741] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:39.974987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.043224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bd947-3416-4d87-971f-448b3ae84940 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.081062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.081888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.082277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.082657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.083624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:40.084040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.085590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.104802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 358/742] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 30 10:09:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:40.105885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.115048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240b8a0-542d-41d0-8a9c-4b0a72f07e09 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.153023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.153837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.154225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.154605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.155462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.156936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.177037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 385/743] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:09:39 2022] POST /identity/v3/services => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:40.178483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.217075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:40.223051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:40.235185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2e5a-1cd5-412d-8b86-5f067fc0fffd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.283562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc73e0-f196-46f8-8f53-dd6c071b8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.284599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc73e0-f196-46f8-8f53-dd6c071b8c6d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.285087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc73e0-f196-46f8-8f53-dd6c071b8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.285550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc73e0-f196-46f8-8f53-dd6c071b8c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.286532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc73e0-f196-46f8-8f53-dd6c071b8c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:40.287134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc73e0-f196-46f8-8f53-dd6c071b8c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.288794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc73e0-f196-46f8-8f53-dd6c071b8c6d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.301914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933541-69eb-4474-82d1-58a777d3bb5d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.302467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 359/744] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:40.304086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58222b0-d8ab-4eb3-b6c4-f88cdfbdb4e5 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.304623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58222b0-d8ab-4eb3-b6c4-f88cdfbdb4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.305104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58222b0-d8ab-4eb3-b6c4-f88cdfbdb4e5 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.307588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 360/745] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:40.308693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58222b0-d8ab-4eb3-b6c4-f88cdfbdb4e5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.354421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.355118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.355403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.355680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.441140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58222b0-d8ab-4eb3-b6c4-f88cdfbdb4e5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.444747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.446486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.486715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:40.494732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110c61d-0a6d-417b-a535-8f5e26bafadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.494732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c61d-0a6d-417b-a535-8f5e26bafadb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.494732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c61d-0a6d-417b-a535-8f5e26bafadb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.495066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c61d-0a6d-417b-a535-8f5e26bafadb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.504405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110c61d-0a6d-417b-a535-8f5e26bafadb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.506341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110c61d-0a6d-417b-a535-8f5e26bafadb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-0110c61d-0a6d-417b-a535-8f5e26bafadb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:40.525244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:40.526288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:40.527222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 361/746] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:40.528147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0242-3d3d-46cc-abf1-972623b66163 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.530708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0242-3d3d-46cc-abf1-972623b66163 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.530708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a0242-3d3d-46cc-abf1-972623b66163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.542406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:40.551587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ab5a0242-3d3d-46cc-abf1-972623b66163 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:40.552968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ab5a0242-3d3d-46cc-abf1-972623b66163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:40.578070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 386/747] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:09:40.579181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.641359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 362/748] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:40.642329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a0242-3d3d-46cc-abf1-972623b66163 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.711163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988c5e-3657-4ba9-bee3-78a16e42180c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.749272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:40.755191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a0242-3d3d-46cc-abf1-972623b66163 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.759375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.760250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.760805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.761225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.762162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:40.762616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.764289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.777336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 387/749] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:40.778482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.797075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.798042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.798334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.798614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.801769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:40.812617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.814365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:40.833749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:40.834869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:40.835850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:40.835850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:40.835850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:40.835850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:40.842478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 363/750] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:40.843592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:40.905709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10172e-6b09-4fa3-ad3b-178f76134660 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.945271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:40.946645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:40.947307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:40.947762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:40.948633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:40.950177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:40.958820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8931ed-232f-4f8c-907a-87dd22d03504 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:40.964342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:40.965313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:40.966126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:40.968872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 388/751] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:40.969986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.003038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.003705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.003990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.004270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.005450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=98c15d7378aa4684978de5fc5dd757fd) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:41.005909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.007543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.015078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 364/752] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/role_assignments?user.id=98c15d7378aa4684978de5fc5dd757fd&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:41.015904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.047829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:41.145112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:41.146598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2404364-7403-408d-b5cd-133c7edffbc8 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:41.197538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.198644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.198644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.198644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.199455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:41.199772 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.201189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.220985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fd898-6008-4909-969c-c7f08d746fd9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:41.226078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 389/753] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:41.231800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.271042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.271042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.271042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.271042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.271447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:41.271447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.271447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.280013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 365/754] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 30 10:09:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:41.290287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.408973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf07b1-834f-44b3-8540-65e69b7cb2e1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:41.426834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:41.430539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf922b4-5026-48b6-b9a7-8f0dd07bfe9c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:41.451883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.452563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.453702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.453969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.454723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:41.455276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.457874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:41.460743 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.469161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 366/755] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 30 10:09:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:41.475011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.500460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.502886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.503171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.503446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.520315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.523593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:41.553261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:41.554210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:41.555503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 390/756] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:41.561862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.637836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae320ef8-b014-4d06-a9b2-b365bd0167e5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:41.673896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.674698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.674992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.675267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.676042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] RBAC: Adding query filter params (interface=public, service_id=121d84e6247748f7907536fbf77e9219, region_id=RegionOne) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:41.676349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.677727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.687314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 367/757] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:09:41 2022] GET /identity/v3/endpoints?service_id=121d84e6247748f7907536fbf77e9219&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:41.692894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.748041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:41.774489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f777c-c574-47b8-9b40-7fe990bbbc60 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:41.809989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4b7bc-e507-43da-b9e3-cb933c042fd5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:41.844329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d020fe-1e83-4aa7-a2f6-b7f3174868f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.845179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d020fe-1e83-4aa7-a2f6-b7f3174868f4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.845566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d020fe-1e83-4aa7-a2f6-b7f3174868f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.845943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d020fe-1e83-4aa7-a2f6-b7f3174868f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.846860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d020fe-1e83-4aa7-a2f6-b7f3174868f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:41.847277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d020fe-1e83-4aa7-a2f6-b7f3174868f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.847747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:41.848575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.848992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.849102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d020fe-1e83-4aa7-a2f6-b7f3174868f4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.849488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.850353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:41.852141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:41.862799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 368/758] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:09:41 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:41.868878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 391/759] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:41.870310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:41.966384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b1fe-b031-42f3-b441-b5af89dfc31b None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.967049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b1fe-b031-42f3-b441-b5af89dfc31b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.967575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b1fe-b031-42f3-b441-b5af89dfc31b None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:41.970861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 392/760] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:41.974742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0905a32-9aad-4379-8fc4-2ac43c2b8729 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:41.975339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0905a32-9aad-4379-8fc4-2ac43c2b8729 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:41.975820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0905a32-9aad-4379-8fc4-2ac43c2b8729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.009076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d99bd0-a717-4b16-a120-eef7053ed768 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:42.012931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a0905a32-9aad-4379-8fc4-2ac43c2b8729 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:42.014512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a0905a32-9aad-4379-8fc4-2ac43c2b8729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:42.020274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:42.051588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:42.052538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:42.052958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:42.053363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.054342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=56e635c1ca5341b2892f0c8846b280d0) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:42.054824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:42.056481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:42.063772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 369/761] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:41 2022] GET /identity/v3/role_assignments?user.id=56e635c1ca5341b2892f0c8846b280d0&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:42.076987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:42.138316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 393/762] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:42.162974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:42.279537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e434d7-ace5-4e47-ab27-d1d93563a4fe None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:42.322872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c555-6839-49e3-8df4-0687ea4c05c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:42.323669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c555-6839-49e3-8df4-0687ea4c05c4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:42.323949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c555-6839-49e3-8df4-0687ea4c05c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:42.324221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c555-6839-49e3-8df4-0687ea4c05c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.343579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c555-6839-49e3-8df4-0687ea4c05c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-90e8c555-6839-49e3-8df4-0687ea4c05c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:42.351237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:42.352322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:42.353291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 370/763] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:42.358493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0905a32-9aad-4379-8fc4-2ac43c2b8729 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:42.444120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659165b-425a-466b-96c9-e7a027f2200b None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:42.444450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659165b-425a-466b-96c9-e7a027f2200b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:42.444683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659165b-425a-466b-96c9-e7a027f2200b None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.446569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 371/764] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:42.451796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9010-0c7b-4860-bd71-cc0392cea7af None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:42.452083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9010-0c7b-4860-bd71-cc0392cea7af None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:42.452361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9010-0c7b-4860-bd71-cc0392cea7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.491216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ef1c9010-0c7b-4860-bd71-cc0392cea7af None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:42.492446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ef1c9010-0c7b-4860-bd71-cc0392cea7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:42.524081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0905a32-9aad-4379-8fc4-2ac43c2b8729 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:42.555210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:42.610539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 372/765] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:42.610909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:42.611603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:42.611892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:42.612174 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.612948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:42.613262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:42.614649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:42.633185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 394/766] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:42.638996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9010-0c7b-4860-bd71-cc0392cea7af None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:42.648030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:42.695057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:42.781825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9010-0c7b-4860-bd71-cc0392cea7af None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:42.809435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc1827-df7f-4156-9904-bf173eaa6a91 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:42.843223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:42.844529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:42.844818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:42.845092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.857282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:42.858781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:42.879506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:42.880431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:42.881333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:42.881333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:42.881333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:42.881333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:42.881333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 373/767] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:42.887063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:42.903409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:42.903729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:42.904226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:42.904511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:42.904795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] PATH_INFO: `/v3/services/network` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:42.905467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:42.906874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:42.932048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:42.933135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:42.933978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:42.945195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 395/768] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:42 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:42.950863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.063686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd3a4d-e3b3-4d2b-be30-822dbd421df8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.105639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:43.118386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c597a-34d6-4439-b676-0bb6d84fbe48 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.143475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.144113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.144401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.144683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.145419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:43.145728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.147468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.159712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.160702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.161187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.161707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.162671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] RBAC: Adding query filter params (name=network) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:43.163210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.164771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.170710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 396/769] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:09:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:43.174888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 374/770] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:43.176432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.179662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.281229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48939907-85d8-4342-add5-0a550f75eb06 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.293325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:43.319727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.320788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.321551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.322073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.323131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] RBAC: Adding query filter params (type=network) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:43.323642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.325238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.331379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 397/771] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:43.340669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.343889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4252b-5a0e-4591-9cc8-5156b308f041 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.379741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.380536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.380827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.381109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.389086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.390557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.403049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:43.405381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:43.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:43.408320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:43.411376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 375/772] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:43.412640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.521384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5de4c-f0c4-4914-a0e2-5d7ec523c356 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.554571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6483-4d9c-4bee-83af-28cbca8f402b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.597291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c287bff-9745-4be0-9f2f-4645ae9d644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.597881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c287bff-9745-4be0-9f2f-4645ae9d644a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.598162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c287bff-9745-4be0-9f2f-4645ae9d644a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.598436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c287bff-9745-4be0-9f2f-4645ae9d644a None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.599302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c287bff-9745-4be0-9f2f-4645ae9d644a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:43.599612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c287bff-9745-4be0-9f2f-4645ae9d644a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.601048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c287bff-9745-4be0-9f2f-4645ae9d644a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.603057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:43.625567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5736-643f-46a5-9f5b-54e7e683affb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.626243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5736-643f-46a5-9f5b-54e7e683affb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.626530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5736-643f-46a5-9f5b-54e7e683affb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.626852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5736-643f-46a5-9f5b-54e7e683affb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.627655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5736-643f-46a5-9f5b-54e7e683affb None admin] RBAC: Adding query filter params (interface=public, service_id=1b3caf73de2d4aefb2196ee2d0172e8d, region_id=RegionOne) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:43.627975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5736-643f-46a5-9f5b-54e7e683affb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.629369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5736-643f-46a5-9f5b-54e7e683affb None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.631669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 376/773] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:43.633072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570063-fce6-498e-9935-2e17de45e31f None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.633365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570063-fce6-498e-9935-2e17de45e31f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.633645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570063-fce6-498e-9935-2e17de45e31f None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.635482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 377/774] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:43.636735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd570063-fce6-498e-9935-2e17de45e31f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.646201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 398/775] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/endpoints?service_id=1b3caf73de2d4aefb2196ee2d0172e8d&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:43.647613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ee1b1-71e1-4210-81c9-4eb19dc81d9d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.647902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ee1b1-71e1-4210-81c9-4eb19dc81d9d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.648180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ee1b1-71e1-4210-81c9-4eb19dc81d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.666204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e55ee1b1-71e1-4210-81c9-4eb19dc81d9d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:43.667536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e55ee1b1-71e1-4210-81c9-4eb19dc81d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:43.742480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd570063-fce6-498e-9935-2e17de45e31f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.746800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 399/776] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:43.747688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ee1b1-71e1-4210-81c9-4eb19dc81d9d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.766831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:43.786036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.787324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.787652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.787927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.799571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.801106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:43.823238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:43.824373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:43.825356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:43.825356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:43.825356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:43.825356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:43.825356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 378/777] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:43.825630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.874924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ee1b1-71e1-4210-81c9-4eb19dc81d9d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:43.881615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:43.920011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:43.921195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:43.921684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:43.922566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:43.923732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:43.925910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:43.933503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 400/778] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:43.934674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:43.944732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f4d4c-e93a-48d7-8264-b1338c7634a4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.003119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.004332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.004819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.005298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.018537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:44.027263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:44.028261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:44.029081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:44.031615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 379/779] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:44.038068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.047755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:44.103781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfe60-a6ef-4178-890b-f3e804034d3e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.142900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.143892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.144180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.144454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.145184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:44.145492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.147507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.162464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 401/780] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:44.168099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.172677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c4698-f1f1-4974-8218-180f0e13be1e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.175125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:44.216607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.217289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.217579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.217882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.218781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:44.219092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.220478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.235061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 380/781] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:44.244518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.375932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfae68-f851-4609-9b7d-61f5111318d5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.378201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3dbe-926b-4243-977f-7f238eef41fe None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.414199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f1dab-7139-4eca-a4ed-28c2bef3cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.415029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1dab-7139-4eca-a4ed-28c2bef3cc4d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.415312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1dab-7139-4eca-a4ed-28c2bef3cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.416143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f1dab-7139-4eca-a4ed-28c2bef3cc4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.427428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f1dab-7139-4eca-a4ed-28c2bef3cc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.428913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f1dab-7139-4eca-a4ed-28c2bef3cc4d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.431115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea236b-7714-4e43-bc45-bd635002e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.433426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea236b-7714-4e43-bc45-bd635002e83a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.433946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea236b-7714-4e43-bc45-bd635002e83a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.434422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea236b-7714-4e43-bc45-bd635002e83a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.442094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea236b-7714-4e43-bc45-bd635002e83a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.443586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea236b-7714-4e43-bc45-bd635002e83a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-dd4f1dab-7139-4eca-a4ed-28c2bef3cc4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:44.449101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:44.449957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:44.450868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:44.450868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:44.450868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:44.450868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:44.453071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 381/782] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:44.454585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1b55-f4a8-4feb-b089-ac7ef2258e44 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.455110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1b55-f4a8-4feb-b089-ac7ef2258e44 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.455611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1b55-f4a8-4feb-b089-ac7ef2258e44 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.457423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 382/783] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:44.458362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e1b55-f4a8-4feb-b089-ac7ef2258e44 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.459060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-e8ea236b-7714-4e43-bc45-bd635002e83a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:44.463946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:44.464828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:44.466071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:44.469949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 402/784] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:44.471287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e385e-4dd0-4d81-ada6-84636778be9d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.471576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e385e-4dd0-4d81-ada6-84636778be9d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.471854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e385e-4dd0-4d81-ada6-84636778be9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.485254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:44.498993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ad8e385e-4dd0-4d81-ada6-84636778be9d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:44.500198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ad8e385e-4dd0-4d81-ada6-84636778be9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:44.579391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e1b55-f4a8-4feb-b089-ac7ef2258e44 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.583618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 403/785] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:44.584526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e385e-4dd0-4d81-ada6-84636778be9d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.637895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.638565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.638879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.639155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.639879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:44.640186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.641578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.654820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 383/786] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:44.655664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.700476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e385e-4dd0-4d81-ada6-84636778be9d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.723463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:44.734418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586aa66f-3862-4892-84d6-65a771edfb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.735103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aa66f-3862-4892-84d6-65a771edfb70 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.735387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aa66f-3862-4892-84d6-65a771edfb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.735661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586aa66f-3862-4892-84d6-65a771edfb70 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.736444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586aa66f-3862-4892-84d6-65a771edfb70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:44.736750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586aa66f-3862-4892-84d6-65a771edfb70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.738181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586aa66f-3862-4892-84d6-65a771edfb70 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.754735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 404/787] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:44.754735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800f5b-f173-467a-b019-5b58312262ac None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.754735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800f5b-f173-467a-b019-5b58312262ac None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.754735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79800f5b-f173-467a-b019-5b58312262ac None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.754735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 405/788] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:44.754735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79800f5b-f173-467a-b019-5b58312262ac None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.758985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:44.788095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4217-b180-4c13-945b-4cbd211bf8cd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.826883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.828296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.828956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.830166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.831097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.832665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:44.848891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:44.849908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 10:09:44.850766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:44.852060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 384/789] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 30 10:09:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:44.852864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:44.862854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79800f5b-f173-467a-b019-5b58312262ac None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.900641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a934-c859-44f2-a76d-4e8a162711c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:44.901604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a934-c859-44f2-a76d-4e8a162711c5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.901944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a934-c859-44f2-a76d-4e8a162711c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.902635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a934-c859-44f2-a76d-4e8a162711c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.912549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a934-c859-44f2-a76d-4e8a162711c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:44.914503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a934-c859-44f2-a76d-4e8a162711c5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-a4a5a934-c859-44f2-a76d-4e8a162711c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:44.929885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:44.930937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:44.932410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 406/790] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:09:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:44.933486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d743-cf87-4a7d-af79-890443e2afac None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:44.933486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d743-cf87-4a7d-af79-890443e2afac None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:44.933714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913d743-cf87-4a7d-af79-890443e2afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:44.951691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9913d743-cf87-4a7d-af79-890443e2afac None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:44.952826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9913d743-cf87-4a7d-af79-890443e2afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:44.961863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0effea5-47ed-4713-988d-d37af4afe76e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:44.996775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.001241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.002130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.002409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.002697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/a8c2616d20ea41f7ad4f953138f5636e/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.004723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=a8c2616d20ea41f7ad4f953138f5636e, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.006170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.022397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 385/791] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:44 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/a8c2616d20ea41f7ad4f953138f5636e/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:45.023953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.028693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 407/792] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:45.029973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d743-cf87-4a7d-af79-890443e2afac None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.035570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.169929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913d743-cf87-4a7d-af79-890443e2afac None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.190969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34116819-4632-4015-bfa0-f54f07f99fd6 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.210118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.210776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.211055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.211339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.212205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:45.213074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.214577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.230819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.231584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.231937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.232290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.233064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:45.233438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.234012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 408/793] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:45.235025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.235161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.240788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 386/794] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:45.241689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.279577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.315257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.352657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8643e-2d1c-48d6-a100-a4b8c911fd01 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.362275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62314b4a-f6d2-4e4d-a055-4b99bd0e5c63 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.388541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.389403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.389686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.390011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.400084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.401136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.401504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:45.401854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.402346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:45.409422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:45.410345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:45.411224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:45.415649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 409/795] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:45.416525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.417730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.419571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:45.439701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:45.440590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:45.441454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:45.441454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:45.441454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:45.441454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:45.443869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 387/796] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:45.444936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.518225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.527781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e4fc5-b138-421d-b2a7-b1f742989f2b None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.559882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5b6f-2aa1-4232-a97a-62749ba9366f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.563901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.564566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.564896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.565174 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.565887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:45.566247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.567669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.578071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 410/797] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:45.578973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.581309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.605718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.606798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.607348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.607927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.608869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:45.609390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.611232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.621368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 388/798] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:45.622493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.692687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc889-af11-471f-9450-c7314b9c5683 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.729094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.729983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.730271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.730547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.731290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:45.731597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.733024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.746106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 411/799] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:45.747046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.747517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e2f96-050d-484d-8971-de1ab42e0dfe None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.765553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.787604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.788620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.789111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.789643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.791141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.792885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:45.818905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 389/800] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:09:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:45.820447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:45.899536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de572a-0e14-455c-824f-eb1231d1600c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:45.902933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:45.952607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:45.953976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:45.955310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:45.955968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:45.979107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:45.983299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:46.014565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:46.015526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:46.016420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:46.016420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:46.016420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:46.016420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:46.020433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 412/801] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:46.028185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.044410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b1e0-a1ac-482e-95fe-d88ecc0cad31 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.092118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.093435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.094131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.094575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.105730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.108200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.110213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:46.130343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:46.131366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:46.132232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:46.135446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 390/802] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:46.140603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.158187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bade8b-81d0-4095-a1a1-25ff2e05dfd4 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.207235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f0bfb-d74d-4c6c-8398-72e85cbedda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.208029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0bfb-d74d-4c6c-8398-72e85cbedda8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.208537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0bfb-d74d-4c6c-8398-72e85cbedda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.209039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f0bfb-d74d-4c6c-8398-72e85cbedda8 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.210303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f0bfb-d74d-4c6c-8398-72e85cbedda8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:46.210803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f0bfb-d74d-4c6c-8398-72e85cbedda8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.212236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f0bfb-d74d-4c6c-8398-72e85cbedda8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.225516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 413/803] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:46.227140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dffc-f048-45c5-978e-ceb74f04d6fd None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.227957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dffc-f048-45c5-978e-ceb74f04d6fd None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.228683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dffc-f048-45c5-978e-ceb74f04d6fd None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.231090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 414/804] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:46.231940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8dffc-f048-45c5-978e-ceb74f04d6fd None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.286619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:46.293846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba150-798b-4957-af97-4db327f43a49 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.332458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e6ec1-2201-45cd-8bf3-27f133d07adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.333520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e6ec1-2201-45cd-8bf3-27f133d07adc None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.333950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e6ec1-2201-45cd-8bf3-27f133d07adc None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.334372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e6ec1-2201-45cd-8bf3-27f133d07adc None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.335377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e6ec1-2201-45cd-8bf3-27f133d07adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:46.336250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e6ec1-2201-45cd-8bf3-27f133d07adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.338248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e6ec1-2201-45cd-8bf3-27f133d07adc None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.354401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 391/805] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:46.356472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47d83-e349-4350-86bf-d8dddafdc819 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.356921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47d83-e349-4350-86bf-d8dddafdc819 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.357608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd47d83-e349-4350-86bf-d8dddafdc819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.363605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8dffc-f048-45c5-978e-ceb74f04d6fd None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.377168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-cbd47d83-e349-4350-86bf-d8dddafdc819 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:46.378404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cbd47d83-e349-4350-86bf-d8dddafdc819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:46.396122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:46.415441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.416787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.417070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.417348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.430479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.432287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:46.451815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:46.452749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:46.453706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:46.460778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 415/806] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:46.460778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.474617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 392/807] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:46.476032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47d83-e349-4350-86bf-d8dddafdc819 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.570976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595e8f3-a2d4-4f1b-9d62-bb04e08f8b1c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.603897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:46.609327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.610621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.611033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.611415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/98c15d7378aa4684978de5fc5dd757fd/roles/343c9b57a593491fb88af31c81cda9ed` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.624211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd47d83-e349-4350-86bf-d8dddafdc819 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.633966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=98c15d7378aa4684978de5fc5dd757fd, role_id=343c9b57a593491fb88af31c81cda9ed)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.636796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.658056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 416/808] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:46 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/98c15d7378aa4684978de5fc5dd757fd/roles/343c9b57a593491fb88af31c81cda9ed => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:46.659523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.666999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.667702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.667988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.668361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.669234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:46.669546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.671159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.705365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 393/809] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 30 10:09:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:46.711307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.725457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:46.845565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf53a-5cea-4617-8618-cddf40fd394d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.886717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.887536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.887823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.888104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] PATH_INFO: `/v3/services/network` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.888769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.890154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:46.902577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:46.903618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:46.904449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 417/810] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:46 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:46.911802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:46.920632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f897-4c0f-458e-9f87-d9f1f8c03fd8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:46.970237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:46.978733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:46.978733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:46.978733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:46.996014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:46.997509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:47.009876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:47.032742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:47.033711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:47.034606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:47.034606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:47.034606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:47.034606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:47.039344 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 394/811] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:47.044889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.067618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:47.074173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96c26b-72cf-4dc3-92a5-4334035c8bea None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.132674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.133684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.133884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.134122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.135515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] RBAC: Adding query filter params (name=network) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:47.135822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:47.137194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:47.149787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 418/812] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:09:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:47.155639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.180302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d2e1-9b52-4c78-aaac-4c602406d956 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.227080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03a135-f647-4bf1-9aeb-a507c77c9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.229260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a135-f647-4bf1-9aeb-a507c77c9970 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.229833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a135-f647-4bf1-9aeb-a507c77c9970 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.230291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03a135-f647-4bf1-9aeb-a507c77c9970 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.231513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a135-f647-4bf1-9aeb-a507c77c9970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:47.232387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a135-f647-4bf1-9aeb-a507c77c9970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:47.233962 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03a135-f647-4bf1-9aeb-a507c77c9970 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:47.251498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 395/813] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:47.253220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6cd3-3ffa-4094-b92e-0a8dbe623b58 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.253725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6cd3-3ffa-4094-b92e-0a8dbe623b58 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.254199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6cd3-3ffa-4094-b92e-0a8dbe623b58 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.256240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 396/814] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:47.257215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6cd3-3ffa-4094-b92e-0a8dbe623b58 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.297440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c5270-deeb-4e9f-a08e-60a5dfdbddef None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.335478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:47.337202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46003-6da2-4911-ade8-809d7f4d93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.338214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46003-6da2-4911-ade8-809d7f4d93ef None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.338647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46003-6da2-4911-ade8-809d7f4d93ef None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.339098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46003-6da2-4911-ade8-809d7f4d93ef None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.340873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da46003-6da2-4911-ade8-809d7f4d93ef None admin] RBAC: Adding query filter params (type=network) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:47.341369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da46003-6da2-4911-ade8-809d7f4d93ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:47.343303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da46003-6da2-4911-ade8-809d7f4d93ef None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:47.349748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 419/815] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:09:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:47.351537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1191b95-e4e6-44a3-9e13-71e282544688 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.352168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1191b95-e4e6-44a3-9e13-71e282544688 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.352703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1191b95-e4e6-44a3-9e13-71e282544688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.372093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a1191b95-e4e6-44a3-9e13-71e282544688 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:47.373588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a1191b95-e4e6-44a3-9e13-71e282544688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:47.390817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6cd3-3ffa-4094-b92e-0a8dbe623b58 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.396918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:47.437090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.437906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.438186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.438466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.450734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:47.450734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:47.457102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 420/816] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:47.458125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1191b95-e4e6-44a3-9e13-71e282544688 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:47.466302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:47.467393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:47.468275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 397/817] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:47.473009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.582114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1191b95-e4e6-44a3-9e13-71e282544688 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.615689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2998f-c50e-4e0c-aad2-5d3342478d65 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.621802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.622462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.622774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.623057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.623799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:47.625710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:47.635578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:47.662751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 421/818] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:09:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:47.662751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.682787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.683471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.683756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.684037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.684846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:47.685158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:47.689307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:47.701294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:47.718773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 398/819] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:47.725656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.844441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0f92-0467-48f1-9f7a-d12fc1f13536 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.882187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.883358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.883841 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.884425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.907075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:47.918014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:47.918979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:47.919803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:47.922760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 422/820] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:47.926262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:47.933080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871409e-b5b9-48aa-b80f-463c22c5a573 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:47.982465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:47.983697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:47.983983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:47.984261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/56e635c1ca5341b2892f0c8846b280d0/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:47.986802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=56e635c1ca5341b2892f0c8846b280d0, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:47.988274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.009160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 399/821] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:09:47 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/56e635c1ca5341b2892f0c8846b280d0/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:09:48.016577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:48.058884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb80c-e655-4d56-ae6e-e81ba32772ba None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.099354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e887cd-8939-4552-b4c6-b198691c5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.100419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e887cd-8939-4552-b4c6-b198691c5155 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.100918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e887cd-8939-4552-b4c6-b198691c5155 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.101425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e887cd-8939-4552-b4c6-b198691c5155 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.102409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e887cd-8939-4552-b4c6-b198691c5155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:48.103028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e887cd-8939-4552-b4c6-b198691c5155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.104680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e887cd-8939-4552-b4c6-b198691c5155 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.116277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 423/822] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:48.121842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.166466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:48.249314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6539dc-ea88-4d6b-9ebd-c9fac6067a2b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.284974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.285769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.286053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.286329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.297389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.298915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.308029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66253-4df3-49b2-9c5a-1bd9917d7333 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.308578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66253-4df3-49b2-9c5a-1bd9917d7333 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.309062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66253-4df3-49b2-9c5a-1bd9917d7333 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.310872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 424/823] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:48.315733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab9a9-921b-4cec-adba-b7afb04e1873 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.316211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab9a9-921b-4cec-adba-b7afb04e1873 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.316667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfab9a9-921b-4cec-adba-b7afb04e1873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:48.317403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:48.318454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:48.319599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:48.319599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:48.319599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:48.319599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:48.325525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 400/824] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:48.327726 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.338604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-cbfab9a9-921b-4cec-adba-b7afb04e1873 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:48.340060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cbfab9a9-921b-4cec-adba-b7afb04e1873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:48.418737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 425/825] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:48.433399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:48.440326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab9a9-921b-4cec-adba-b7afb04e1873 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.453401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94d4c8-ea0a-48c4-992d-f4f4cca825b4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.491651 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.492664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.493149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.494144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.495092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:48.495608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.497793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.510524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:48.515967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 401/826] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:48.517417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.553644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfab9a9-921b-4cec-adba-b7afb04e1873 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.591065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.591912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.592197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.592471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.593183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.594486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:48.607050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:48.608076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:48.608899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:48.613346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 426/827] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:48.613946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.645742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a787c-8594-4498-99ae-d03a82d4f80f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.690303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.691558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.692808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.693262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.703243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.704915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:48.724110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:48.725248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:09:48.726442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:48.727532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e14d8-5a4e-4dfe-b59e-f2b391c9e2ab None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.734782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 402/828] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:48.740123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.745749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:48.766021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:48.776214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.777184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.777721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.778316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.779271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:48.779776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.781461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.792597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 427/829] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:48.793755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.860572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c35e24-0f71-47e7-aab7-3def471e275b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.897418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.898416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.899014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.899500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.900635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:48.901150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.902972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.917439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bfaa2-b038-4d72-9dae-7d5da66086d1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:48.923813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 403/830] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:48.929299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:48.958604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ef1e8-160c-41b9-a0df-2e974737b6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:48.959338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ef1e8-160c-41b9-a0df-2e974737b6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.959621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ef1e8-160c-41b9-a0df-2e974737b6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.959896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ef1e8-160c-41b9-a0df-2e974737b6c9 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.960790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ef1e8-160c-41b9-a0df-2e974737b6c9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:48.961106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ef1e8-160c-41b9-a0df-2e974737b6c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:48.962657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ef1e8-160c-41b9-a0df-2e974737b6c9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:48.967808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 428/831] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:48.995999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a65cc-25fc-4303-a2f7-dc85b6809071 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:48.996420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a65cc-25fc-4303-a2f7-dc85b6809071 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:48.996673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a65cc-25fc-4303-a2f7-dc85b6809071 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:48.998197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 429/832] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:49.005539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1d7e-f46a-4916-9389-d62a7418b940 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.006264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1d7e-f46a-4916-9389-d62a7418b940 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.006834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1d7e-f46a-4916-9389-d62a7418b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.007379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:49.025941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-eedf1d7e-f46a-4916-9389-d62a7418b940 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:49.027111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-eedf1d7e-f46a-4916-9389-d62a7418b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:49.057993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aadf3-d8d1-4820-ae5d-d40b874c4595 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.084949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:49.097561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.098478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.098910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.099282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.111070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 430/833] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:49.140498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1d7e-f46a-4916-9389-d62a7418b940 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.182067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:49.184597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:49.267825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1d7e-f46a-4916-9389-d62a7418b940 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.274004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:49.316269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.316977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.317258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.317533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.319591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 404/834] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:09:49.326734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.333851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:49.343664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:49.344603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:09:49.345869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:49.349865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 431/835] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:49.350741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.416747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:49.448080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb378d-dbfb-44c9-abc5-81df9adb6699 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.481583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1ebec-caa3-4832-8592-0b78c625631f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.494747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.495821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.496305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.496785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.507689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:49.509419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:49.517130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.517738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.518023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.518297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.519076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:49.519384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:49.520859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:49.529579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:49.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:49.531727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:49.531727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:49.531727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:49.531727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:49.534227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 432/836] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:49.538548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.538831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 405/837] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:49.540246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.557507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:49.644415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895442e3-049c-491a-8c01-03297d22de67 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.646250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7426f-304d-48c2-b138-2102a3c24925 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.663053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:49.682847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.683735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.684127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.684534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.684904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.685015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.685219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.685654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.686560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:49.687161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:49.688767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:49.698943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:49.700389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:49.707027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 406/838] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:49.708588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:49.719264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:49.720177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:49.721474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:49.721474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:49.721474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:49.721474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:49.725221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 433/839] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:49.726035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.791117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:49.817623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca94e3-e86e-4b1c-9372-936031e98961 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.842356 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5704f38-c26b-4ff3-a6e1-4f6e523cc6a6 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:49.854506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.855421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.855772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.856087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.863149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:49.864725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:49.879580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:49.880530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:49.881416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:49.883597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:49.885037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:49.885509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:49.885938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:49.886543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 407/840] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:49.887151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:49.887637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:49.887946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:49.889563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:50.009314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172e6a0-4c8c-488b-81d7-7f75ff687143 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.023677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 434/841] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:50.025555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.052051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.148327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95d1be-2840-4237-a49b-62c3b27faa34 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.169462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05529a78-4f3c-4eac-972f-6474d59ab9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.170127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529a78-4f3c-4eac-972f-6474d59ab9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.170408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529a78-4f3c-4eac-972f-6474d59ab9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.170700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05529a78-4f3c-4eac-972f-6474d59ab9c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.171492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529a78-4f3c-4eac-972f-6474d59ab9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:50.171804 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529a78-4f3c-4eac-972f-6474d59ab9c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:50.173238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05529a78-4f3c-4eac-972f-6474d59ab9c2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:50.175001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.190808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 408/842] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:50.190808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77872-1dbd-42db-878a-d6668f09df71 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.190808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77872-1dbd-42db-878a-d6668f09df71 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.190808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77872-1dbd-42db-878a-d6668f09df71 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.191195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650c2b8-c193-45b0-a066-9cf762606792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.191195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c2b8-c193-45b0-a066-9cf762606792 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.191195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c2b8-c193-45b0-a066-9cf762606792 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.191195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650c2b8-c193-45b0-a066-9cf762606792 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.191473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 409/843] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:50.192719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77872-1dbd-42db-878a-d6668f09df71 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.203439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650c2b8-c193-45b0-a066-9cf762606792 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:50.205260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650c2b8-c193-45b0-a066-9cf762606792 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c650c2b8-c193-45b0-a066-9cf762606792 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:50.222301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:50.223320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:50.224255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 435/844] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:50.224829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271a79-9d76-42e2-9b7a-c9cd14364111 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.225719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271a79-9d76-42e2-9b7a-c9cd14364111 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.225719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271a79-9d76-42e2-9b7a-c9cd14364111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.244695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-0d271a79-9d76-42e2-9b7a-c9cd14364111 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:50.245892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0d271a79-9d76-42e2-9b7a-c9cd14364111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:50.317272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77872-1dbd-42db-878a-d6668f09df71 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.332307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 436/845] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:50.333357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271a79-9d76-42e2-9b7a-c9cd14364111 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.348478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.366629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.367313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.367597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.367874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.368708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=a8c2616d20ea41f7ad4f953138f5636e) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:50.369022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:50.370457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:50.386716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 410/846] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/role_assignments?user.id=a8c2616d20ea41f7ad4f953138f5636e&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:50.386716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.454134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.468701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d271a79-9d76-42e2-9b7a-c9cd14364111 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.512293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e03d33-712a-446a-80be-df9d81748f43 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.516997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.518021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.518619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.519129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.520193 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:50.520712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:50.522449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:50.553424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 437/847] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:50.554557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.559050 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.559867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.560156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.560450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.576146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:50.584348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:50.585318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 411/848] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:50.591901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.664761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.712211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26723-5ef7-441b-93a6-090eb74adb32 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.736628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbae00-1b7a-4a26-b07d-6d9967080059 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.755202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.755856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.756140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.756412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.757102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.778667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.779463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.779820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:50.780325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:50.781444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:50.782064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:50.784483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:50.794780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 412/849] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:50.800175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.844617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:50.845735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:50.919237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:50.948176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976d9a-e482-4587-92ee-a96b5d6f8a4d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:50.966986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 438/850] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:09:50.969474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:50.997233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:50.998968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:50.999769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.000255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.019241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.021874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:51.043136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:51.044357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:51.045338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:51.045338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:51.045338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:51.045338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:51.049338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 413/851] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:51.050228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.084381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.095125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef52c0-85b3-4d60-87c2-595cc5fda734 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.134936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabcf0e-0b91-4c1f-b5eb-defaaed044b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.135910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabcf0e-0b91-4c1f-b5eb-defaaed044b8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.136192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabcf0e-0b91-4c1f-b5eb-defaaed044b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.136468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabcf0e-0b91-4c1f-b5eb-defaaed044b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.146476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabcf0e-0b91-4c1f-b5eb-defaaed044b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.147962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabcf0e-0b91-4c1f-b5eb-defaaed044b8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.161118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41549e-6a4d-48d5-ac90-175e259158b4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-3cabcf0e-0b91-4c1f-b5eb-defaaed044b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:51.166553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:51.167492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:51.168363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:51.168363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:51.168363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:51.168363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:51.168363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 439/852] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:51.169512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864847-4555-4c15-af9a-60133c031949 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.169801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864847-4555-4c15-af9a-60133c031949 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.170078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864847-4555-4c15-af9a-60133c031949 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.174810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 440/853] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:51.175840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864847-4555-4c15-af9a-60133c031949 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.198587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.209664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57480883-0eee-4716-afe9-3c0de0c539e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.211235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480883-0eee-4716-afe9-3c0de0c539e7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.211701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480883-0eee-4716-afe9-3c0de0c539e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.212146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57480883-0eee-4716-afe9-3c0de0c539e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.213038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480883-0eee-4716-afe9-3c0de0c539e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:51.213538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480883-0eee-4716-afe9-3c0de0c539e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.215068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57480883-0eee-4716-afe9-3c0de0c539e7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.229876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 414/854] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:51.231412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f0f6-ebb0-4e33-9d5e-c0a0c906cf7e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.232051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f0f6-ebb0-4e33-9d5e-c0a0c906cf7e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.232532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0f0f6-ebb0-4e33-9d5e-c0a0c906cf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.251788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-60e0f0f6-ebb0-4e33-9d5e-c0a0c906cf7e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:51.252973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-60e0f0f6-ebb0-4e33-9d5e-c0a0c906cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:51.298498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864847-4555-4c15-af9a-60133c031949 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.322585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 415/855] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:51.323860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f0f6-ebb0-4e33-9d5e-c0a0c906cf7e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.338086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.338770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.339054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.339328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.340048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:51.340350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.341717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.354027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 441/856] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:51.354779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.365638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.435938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.451388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0f0f6-ebb0-4e33-9d5e-c0a0c906cf7e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.457817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7fc2a-bcd8-4fcf-987f-1ae9601ebc18 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.491571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.492379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.492644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.492917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.497252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.497910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.498192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.498465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.499220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.500575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.500759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.502195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.522716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 442/857] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:09:51 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:51.522716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:51.523036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:51.524095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 416/858] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:51.525302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.629925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.651230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb899aab-0c07-4228-badc-cb94ae7d9466 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.691472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93ce24-dfe3-4d59-b500-e41f04a6ff99 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.699539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.701623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.701623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.701623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.703629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:51.703629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.706138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.729423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 417/859] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:51.734278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.740786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.741586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.741872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.742149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.746380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.753073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.754884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:51.772304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:51.773252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:51.774156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:51.778589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 443/860] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:51.779457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.850049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726b69b-f302-46ce-9874-be90b551cb04 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.891354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.891954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9832c3-163a-4131-9df0-02643f47e60f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:51.892141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.892278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.892553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.904614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:51.928024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:51.928793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:51.929118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:51.929470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:51.930325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:51.930717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.932249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:51.949734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 444/861] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:51.950910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:51.976673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:51.978476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.008903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:52.055095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3529c5f-c4a3-49b1-9091-5eb5328d6d26 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:52.091140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:52.091797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.092086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.092362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.093427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 418/862] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:09:52.093541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=98c15d7378aa4684978de5fc5dd757fd) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:52.093803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:52.094335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:52.095283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.101839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 445/863] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:51 2022] GET /identity/v3/role_assignments?user.id=98c15d7378aa4684978de5fc5dd757fd&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:52.147577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:52.210590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c09b-1253-4d4b-963b-bec6ef8ce07c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:52.251871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:52.252742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.253031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.253308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.266285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:52.267814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:52.286992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:52.287941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:52.289763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:52.289763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:52.289763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:52.289763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:52.289763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 419/864] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:52.294233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:52.406222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5068ac-a53e-4368-bdcf-c0f6e4efe29e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:52.427479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:52.443279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:52.443941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.444225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.444501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.445217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:52.445524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:52.447750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.460302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 446/865] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:52.465995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:52.564301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:52.575489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909ceeb-4e27-47b8-8458-ee3b2a55d7df None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:52.612000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd98c85-bfde-4102-997d-601a7bd3c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:52.613188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98c85-bfde-4102-997d-601a7bd3c023 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.613676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98c85-bfde-4102-997d-601a7bd3c023 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.614157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98c85-bfde-4102-997d-601a7bd3c023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.622064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd98c85-bfde-4102-997d-601a7bd3c023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:52.623798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd98c85-bfde-4102-997d-601a7bd3c023 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7bd98c85-bfde-4102-997d-601a7bd3c023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:52.638375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:52.639292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:52.640176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:52.642632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 420/866] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:52.648530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:52.671055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de486e-04b3-4997-83c4-f94ba0f7d34e None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.671329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de486e-04b3-4997-83c4-f94ba0f7d34e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.671531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de486e-04b3-4997-83c4-f94ba0f7d34e None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.673027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 421/867] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:52.677737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df11349-7fac-4afc-a010-8873b7cbfc4e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.678025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df11349-7fac-4afc-a010-8873b7cbfc4e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.678322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df11349-7fac-4afc-a010-8873b7cbfc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.699113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0df11349-7fac-4afc-a010-8873b7cbfc4e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:52.700912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0df11349-7fac-4afc-a010-8873b7cbfc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:52.760402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd94b24-fd87-4703-811c-9182a5797ded None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:52.779820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 422/868] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:52.803822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:52.804483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.804763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.805037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.805770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df11349-7fac-4afc-a010-8873b7cbfc4e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:52.805882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:52.806679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:52.808118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.825122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 447/869] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:52.826210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:52.870252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:52.900445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:52.925624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df11349-7fac-4afc-a010-8873b7cbfc4e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:52.934378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338acdd-058f-4faf-a1c0-71f147723cc2 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:52.964386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:52.965558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.966046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.966547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.967823 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:52.969887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.970991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:52.971639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:52.971917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:52.972190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:52.973006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=56e635c1ca5341b2892f0c8846b280d0) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:52.973315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:52.974736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:52.986725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 448/870] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:52 2022] GET /identity/v3/role_assignments?user.id=56e635c1ca5341b2892f0c8846b280d0&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:52.986934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:52.987798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:52.988623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 423/871] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 30 10:09:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:52.997047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:53.119621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5ffc1-7d3e-4910-8852-e40a6aade669 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:53.122550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:53.159056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49026de3-966f-4d1d-9507-50070eab2a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:53.160031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49026de3-966f-4d1d-9507-50070eab2a0c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:53.160505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49026de3-966f-4d1d-9507-50070eab2a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:53.160947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49026de3-966f-4d1d-9507-50070eab2a0c None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:53.161819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49026de3-966f-4d1d-9507-50070eab2a0c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:53.162513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49026de3-966f-4d1d-9507-50070eab2a0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:53.164214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49026de3-966f-4d1d-9507-50070eab2a0c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:53.169879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 449/872] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:09:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:53.175335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:53.288303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480238b-cdf3-4597-8354-fc39d4de8718 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:53.324792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b026df-a332-4300-b631-a8f1af3366c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:53.325830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b026df-a332-4300-b631-a8f1af3366c5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:53.326335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b026df-a332-4300-b631-a8f1af3366c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:53.326866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b026df-a332-4300-b631-a8f1af3366c5 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:53.327777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b026df-a332-4300-b631-a8f1af3366c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:53.328289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b026df-a332-4300-b631-a8f1af3366c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:53.329875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b026df-a332-4300-b631-a8f1af3366c5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:53.335420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 424/873] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:09:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:53.684260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910acd3c-ddb9-4f4f-9270-c5be11f58695 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:53.684635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910acd3c-ddb9-4f4f-9270-c5be11f58695 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:53.684836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910acd3c-ddb9-4f4f-9270-c5be11f58695 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:53.686418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 450/874] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:53.691834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4308-546b-4244-af04-ff76df11ba3d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:53.692272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4308-546b-4244-af04-ff76df11ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:53.692456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4308-546b-4244-af04-ff76df11ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:53.710217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-239a4308-546b-4244-af04-ff76df11ba3d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:53.711422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-239a4308-546b-4244-af04-ff76df11ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:53.714304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:53.786795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 425/875] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:53.803980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910acd3c-ddb9-4f4f-9270-c5be11f58695 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:53.916542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910acd3c-ddb9-4f4f-9270-c5be11f58695 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:53.953133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:53.954204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:53.954635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:53.955083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:53.955893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:53.957406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:53.969770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:53.970983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:53.972035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:53.977735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 451/876] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:53.984262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a4308-546b-4244-af04-ff76df11ba3d None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:54.088379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a4308-546b-4244-af04-ff76df11ba3d None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:54.124552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:54.125221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.125501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.125776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.126480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:54.126817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:54.128185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:54.137496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 426/877] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:54.139762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:54.173601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:54.246608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3ae19-6d77-4d07-a1ce-d1cf13617a08 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:54.279781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a4bca-8320-4e03-9c71-a69505dfcb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:54.280433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a4bca-8320-4e03-9c71-a69505dfcb2e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.280710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a4bca-8320-4e03-9c71-a69505dfcb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.280981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a4bca-8320-4e03-9c71-a69505dfcb2e None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.281674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a4bca-8320-4e03-9c71-a69505dfcb2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:54.281974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a4bca-8320-4e03-9c71-a69505dfcb2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:54.283350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a4bca-8320-4e03-9c71-a69505dfcb2e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:54.293559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 452/878] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:54.294928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:54.298720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:54.392127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915b8e9-6a25-4947-940a-f308eac94ca6 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.392455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915b8e9-6a25-4947-940a-f308eac94ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.392676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915b8e9-6a25-4947-940a-f308eac94ca6 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.394360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 453/879] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:54.401479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b19a4-d271-4097-89e0-d43466b8ae3c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.401479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b19a4-d271-4097-89e0-d43466b8ae3c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.401479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b19a4-d271-4097-89e0-d43466b8ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.402719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e63c76-b365-43e1-a40a-e94b79040b26 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:54.417852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-7f4b19a4-d271-4097-89e0-d43466b8ae3c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:54.419169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7f4b19a4-d271-4097-89e0-d43466b8ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:54.439607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:54.440596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.441050 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.441491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.442462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] RBAC: Adding query filter params (interface=public, service_id=38b03de081f94cfdbd03b2332517ba0b, region_id=RegionOne) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:54.443002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:54.444727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:54.455683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 427/880] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:09:54 2022] GET /identity/v3/endpoints?service_id=38b03de081f94cfdbd03b2332517ba0b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:54.457161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:54.510829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 454/881] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:54.531316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b19a4-d271-4097-89e0-d43466b8ae3c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:54.551415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:54.566484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:54.598483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a2c77-57cf-47cd-855d-b36d50bd6691 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:54.641281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:54.642041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.642327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.642599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.643316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:54.644788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:54.658878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 428/882] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:09:54 2022] GET /identity/v3/services => generated 1011 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:09:54.660859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b19a4-d271-4097-89e0-d43466b8ae3c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:54.701671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:54.702950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.703474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.704091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.717044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:54.725995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:54.727057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:09:54.728434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:54.731319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 455/883] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 30 10:09:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:54.737595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:54.848574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f4ca4-ed56-4ebe-a931-b97b18a12904 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:54.881934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:54.887775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:54.888451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:54.888736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:54.889009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:54.889756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:54.890061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:54.891480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:54.900703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 429/884] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 30 10:09:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:54.906210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:54.996672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.011941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511320ab-9195-4ef9-ac68-45ba91fd1199 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.047663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2d03-74cc-4424-8033-7999166c3a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.048511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2d03-74cc-4424-8033-7999166c3a41 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.048795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2d03-74cc-4424-8033-7999166c3a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.049124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2d03-74cc-4424-8033-7999166c3a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.061426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2d03-74cc-4424-8033-7999166c3a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.062929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2d03-74cc-4424-8033-7999166c3a41 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-a54b2d03-74cc-4424-8033-7999166c3a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:55.084372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:55.085307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:55.086722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:55.086722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:55.086722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:55.086722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:55.086722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 456/885] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:55.092151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.150239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1fb6-0026-4fbc-ace6-a67df0c2afb4 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.150541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1fb6-0026-4fbc-ace6-a67df0c2afb4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.150830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b1fb6-0026-4fbc-ace6-a67df0c2afb4 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.152526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 457/886] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:55.157637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc8ad-80f2-4bb3-94b8-24531422dde1 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.157924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc8ad-80f2-4bb3-94b8-24531422dde1 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.158199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cc8ad-80f2-4bb3-94b8-24531422dde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.180371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-dd0cc8ad-80f2-4bb3-94b8-24531422dde1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:55.182105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-dd0cc8ad-80f2-4bb3-94b8-24531422dde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:55.207378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c70dfa-38e7-4c2f-9ed1-32fadd819c4f None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.245959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.246628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.246944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.247220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.247947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:55.248252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.249701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.263229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 430/887] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:55.271812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.272895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 458/888] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:55.295183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc8ad-80f2-4bb3-94b8-24531422dde1 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.341194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.382635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.399072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4eb4b-9bb7-4f0c-b2e4-a5c4885472c4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.420103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cc8ad-80f2-4bb3-94b8-24531422dde1 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.449323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40594d-8acc-4f51-b147-a33045a89d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.451128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40594d-8acc-4f51-b147-a33045a89d9d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.451596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40594d-8acc-4f51-b147-a33045a89d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.452324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40594d-8acc-4f51-b147-a33045a89d9d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.461330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a77c1d-28b7-4d69-a1ac-0ad8feef7072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.462143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40594d-8acc-4f51-b147-a33045a89d9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.462256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a77c1d-28b7-4d69-a1ac-0ad8feef7072 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.462643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a77c1d-28b7-4d69-a1ac-0ad8feef7072 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.463010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a77c1d-28b7-4d69-a1ac-0ad8feef7072 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.463791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a77c1d-28b7-4d69-a1ac-0ad8feef7072 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.464559 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40594d-8acc-4f51-b147-a33045a89d9d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.465536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a77c1d-28b7-4d69-a1ac-0ad8feef7072 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-62a77c1d-28b7-4d69-a1ac-0ad8feef7072 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:55.479063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:55.480249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:55.483608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 459/889] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:09:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:55.488450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9dbf-3d6c-410a-913e-952e9ca7f72c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.488450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9dbf-3d6c-410a-913e-952e9ca7f72c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.488450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db9dbf-3d6c-410a-913e-952e9ca7f72c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-db40594d-8acc-4f51-b147-a33045a89d9d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:09:55.488641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:55.489497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:09:55.491488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:55.492034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 460/890] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:55.492104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 431/891] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:09:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:55.492104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca747a-a2ee-46aa-afaf-d4bf393e2555 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.492104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca747a-a2ee-46aa-afaf-d4bf393e2555 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.492104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca747a-a2ee-46aa-afaf-d4bf393e2555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.494970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9dbf-3d6c-410a-913e-952e9ca7f72c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.510425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-29ca747a-a2ee-46aa-afaf-d4bf393e2555 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:55.511648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-29ca747a-a2ee-46aa-afaf-d4bf393e2555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:55.594735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 432/892] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:55.594735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca747a-a2ee-46aa-afaf-d4bf393e2555 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.614072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db9dbf-3d6c-410a-913e-952e9ca7f72c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.644824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.648138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.650338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.650956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.651242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.651534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.652219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:55.652525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.653896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.658598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 461/893] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:09:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:55.659384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.711370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca747a-a2ee-46aa-afaf-d4bf393e2555 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.747855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.748598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.748813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.749095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.749927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:55.750243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.751703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.768869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 433/894] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 30 10:09:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:55.769767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.770423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cacaae-b193-42b5-96b2-31e93f10ee8c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.813755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.814807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.815103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.815372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.816105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.817481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.832826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 462/895] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:09:55 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:55.833770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:55.896807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43869b4b-3198-4294-b07e-50322af4c2ea None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:55.899578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.917729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:55.956453 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:55.957492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:55.957964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:55.958482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:55.959568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:55.960061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:55.961747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:55.968122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 434/896] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:09:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:55.988532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f500c-7809-4fc9-81fc-506f37b264ac None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:56.031304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:56.032032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:56.032322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:56.032603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:56.119235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:56.120785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:56.180813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:56.230591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 463/897] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:09:55 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:09:56.236188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:56.345163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc937-42ac-49a8-a8d2-ab1833d8a392 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:56.382398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:56.383223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:56.383504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:56.383776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:56.395254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:56.396805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:56.416134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:56.417220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:56.418169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:56.418169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:56.418169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:56.418169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:56.418169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 435/898] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:56.423253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:56.536677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cb0c8-f89e-4888-b548-93785073f8e7 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:56.576176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:56.576841 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:56.577132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:56.577414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:56.578139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:56.578448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:56.579856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:56.592317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 464/899] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:56.597763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:56.614619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:56.706795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322e42f-866f-42ee-8866-773b01f2bf24 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:56.744072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc237fbf-7f75-49e3-a681-6428f0d94a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:56.745191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237fbf-7f75-49e3-a681-6428f0d94a38 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:56.745694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237fbf-7f75-49e3-a681-6428f0d94a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:56.746188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237fbf-7f75-49e3-a681-6428f0d94a38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:56.753579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc237fbf-7f75-49e3-a681-6428f0d94a38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:56.755828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc237fbf-7f75-49e3-a681-6428f0d94a38 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-dc237fbf-7f75-49e3-a681-6428f0d94a38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:09:56.770852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:56.771765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:09:56.772661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:56.775132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 436/900] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:09:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:56.781010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:56.795806 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6093-b00e-485e-b817-ca4c176a6163 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:56.796406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6093-b00e-485e-b817-ca4c176a6163 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:56.796990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6093-b00e-485e-b817-ca4c176a6163 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:56.798926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 437/901] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:56.804406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:56.804861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff78d3-2e02-4009-a007-6887d85a6ddc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:56.806560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff78d3-2e02-4009-a007-6887d85a6ddc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:56.807133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff78d3-2e02-4009-a007-6887d85a6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:56.828745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d9ff78d3-2e02-4009-a007-6887d85a6ddc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:56.830032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d9ff78d3-2e02-4009-a007-6887d85a6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:56.895644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a02205-e674-42bf-a5a1-93f46a7cab69 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:56.906803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 438/902] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:56.924172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff78d3-2e02-4009-a007-6887d85a6ddc None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:56.927196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:56.933902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:56.935233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:56.935737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:56.936235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:56.937231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:56.937753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:56.939451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:56.953254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 465/903] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:09:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:56.959276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:57.032639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff78d3-2e02-4009-a007-6887d85a6ddc None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:57.050679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:57.074153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:57.074989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:57.075270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:57.075602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:57.076260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:57.076973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4babcb0-2a20-4794-8c18-1c34270ff183 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:57.077694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:57.089637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:57.090718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:57.091597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 439/904] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:09:57.096737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:57.112533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:57.113184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:57.113469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:57.113753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:57.114577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] RBAC: Adding query filter params (role.id=3b4d675542b74833ab10f0f3cc67f246, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=98c15d7378aa4684978de5fc5dd757fd) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:57.114924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:57.116368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:57.122993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 466/905] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:09:56 2022] GET /identity/v3/role_assignments?user.id=98c15d7378aa4684978de5fc5dd757fd&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=3b4d675542b74833ab10f0f3cc67f246 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:09:57.182986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:57.230996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8a881-918b-4bd0-abea-a382819bbf45 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:57.281834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:57.282506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:57.282869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:57.283095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:57.283815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:57.284122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:57.285510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:57.291772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 440/906] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:57.297200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:57.403113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0cb6-45dc-4b2c-a465-dc4c396037ba None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:57.438903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9efa09-dac6-45cd-a52e-87942dc34c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:57.440156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efa09-dac6-45cd-a52e-87942dc34c2c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:57.440650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efa09-dac6-45cd-a52e-87942dc34c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:57.441247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efa09-dac6-45cd-a52e-87942dc34c2c None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:57.442218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efa09-dac6-45cd-a52e-87942dc34c2c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:57.442767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efa09-dac6-45cd-a52e-87942dc34c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:57.444383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efa09-dac6-45cd-a52e-87942dc34c2c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:57.450158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 467/907] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 30 10:09:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:57.455585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:57.570522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693dd7d-3c4b-42e1-bcff-9d2c534c193d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:57.607024 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:57.612987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251461f-23bc-430e-9a0b-449213b20b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:57.614063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251461f-23bc-430e-9a0b-449213b20b70 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:57.614569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251461f-23bc-430e-9a0b-449213b20b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:57.615169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251461f-23bc-430e-9a0b-449213b20b70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:57.616351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251461f-23bc-430e-9a0b-449213b20b70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:57.617738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251461f-23bc-430e-9a0b-449213b20b70 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:57.641200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 441/908] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:09:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:09:58.004185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830140c-9c61-4f50-88c0-e5a98f5353e2 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.004731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830140c-9c61-4f50-88c0-e5a98f5353e2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.004731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830140c-9c61-4f50-88c0-e5a98f5353e2 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.006360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 468/909] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:58.011759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d6d3-6739-492c-8539-a5c3d2f74b80 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.012167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d6d3-6739-492c-8539-a5c3d2f74b80 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.012331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4d6d3-6739-492c-8539-a5c3d2f74b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.029373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-29e4d6d3-6739-492c-8539-a5c3d2f74b80 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:58.030569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-29e4d6d3-6739-492c-8539-a5c3d2f74b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:58.109505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 442/910] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:58.131469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830140c-9c61-4f50-88c0-e5a98f5353e2 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:58.136555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:58.240865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92d45f-4372-4eed-b0e2-650aeea84239 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.240865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92d45f-4372-4eed-b0e2-650aeea84239 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.240865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92d45f-4372-4eed-b0e2-650aeea84239 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.240865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 443/911] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:58.245796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdbf7c-4bde-46f1-98cd-e5c589764cfb None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.246156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdbf7c-4bde-46f1-98cd-e5c589764cfb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.246512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdbf7c-4bde-46f1-98cd-e5c589764cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.251209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830140c-9c61-4f50-88c0-e5a98f5353e2 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:58.263699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-fabdbf7c-4bde-46f1-98cd-e5c589764cfb None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:58.264896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fabdbf7c-4bde-46f1-98cd-e5c589764cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:58.289914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:58.291365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.291654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.291928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.292593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:58.294220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:58.310932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:58.311953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:09:58.312811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:09:58.314874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 469/912] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 30 10:09:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:58.318626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:58.345437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 444/913] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:58.369882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdbf7c-4bde-46f1-98cd-e5c589764cfb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:58.412675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:58.430601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:58.457532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362da28-29b6-48a8-b418-98e42423006d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:58.508789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:58.509129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdbf7c-4bde-46f1-98cd-e5c589764cfb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:58.509985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.510599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.511100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.512113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:58.512629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:58.514236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:58.519702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 470/914] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:09:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:58.526197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:58.553484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:58.554757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.555487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.556880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.558101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:58.560246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:58.586733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 445/915] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:09:58 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:09:58.658391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1037ddc-9fa9-4571-b7e2-a82c2dd835a0 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:58.694042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:58.707523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:58.708539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.709006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.709437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.710319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:58.710811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:58.712413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:58.718730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 471/916] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:09:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:58.725018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:58.839424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5a372-e448-47f9-b70c-f4e7996b5474 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:58.841785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:58.875981 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc59c6-d69c-4fbf-9e2d-23474e64a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:58.876656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc59c6-d69c-4fbf-9e2d-23474e64a597 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:58.876944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc59c6-d69c-4fbf-9e2d-23474e64a597 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:58.877215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc59c6-d69c-4fbf-9e2d-23474e64a597 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:58.878011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc59c6-d69c-4fbf-9e2d-23474e64a597 None admin] RBAC: Adding query filter params (interface=public, service_id=a3f69a6353214bb1a15e66bdcf3df19b, region_id=RegionOne) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:58.878326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc59c6-d69c-4fbf-9e2d-23474e64a597 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:58.879741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc59c6-d69c-4fbf-9e2d-23474e64a597 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:58.885781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 446/917] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:09:58 2022] GET /identity/v3/endpoints?service_id=a3f69a6353214bb1a15e66bdcf3df19b&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:58.891186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:58.998513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d9f92-d9fa-4729-9710-e2f9270ec63e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:59.034309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0482a5-d82d-4d13-ac36-a143c567ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:59.035818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0482a5-d82d-4d13-ac36-a143c567ac44 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.036317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0482a5-d82d-4d13-ac36-a143c567ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.036809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0482a5-d82d-4d13-ac36-a143c567ac44 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.037697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0482a5-d82d-4d13-ac36-a143c567ac44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:59.039313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0482a5-d82d-4d13-ac36-a143c567ac44 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:59.046448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 472/918] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:09:58 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:09:59.272597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51097ab-042c-46f1-a4d4-2d4a31e77a85 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.273149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51097ab-042c-46f1-a4d4-2d4a31e77a85 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.273149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51097ab-042c-46f1-a4d4-2d4a31e77a85 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.275753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 447/919] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:09:59.281155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ace8a-8bb0-476f-8e78-d34ac74108ec None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.281447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ace8a-8bb0-476f-8e78-d34ac74108ec None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.281726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ace8a-8bb0-476f-8e78-d34ac74108ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.301011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6f1ace8a-8bb0-476f-8e78-d34ac74108ec None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:59.302209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6f1ace8a-8bb0-476f-8e78-d34ac74108ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:59.360187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:59.378409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 473/920] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:09:59.401270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51097ab-042c-46f1-a4d4-2d4a31e77a85 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:59.510632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51097ab-042c-46f1-a4d4-2d4a31e77a85 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:59.546372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:59.547135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.547417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.547688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.558382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:09:59.566649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:59.567588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:59.568431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 448/921] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 30 10:09:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:59.574752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ace8a-8bb0-476f-8e78-d34ac74108ec None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:59.673917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ace8a-8bb0-476f-8e78-d34ac74108ec None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:59.713190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971fccb-109f-4bd5-b19c-0547cd49d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:59.714218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971fccb-109f-4bd5-b19c-0547cd49d3df None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.714758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971fccb-109f-4bd5-b19c-0547cd49d3df None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.715256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971fccb-109f-4bd5-b19c-0547cd49d3df None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.716205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971fccb-109f-4bd5-b19c-0547cd49d3df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:09:59.716731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971fccb-109f-4bd5-b19c-0547cd49d3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:59.718339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971fccb-109f-4bd5-b19c-0547cd49d3df None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:59.727371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 474/922] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 30 10:09:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:09:59.736136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:59.762855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304924-e5ba-4139-a376-28fb4f4531fc None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.763185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304924-e5ba-4139-a376-28fb4f4531fc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.763431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304924-e5ba-4139-a376-28fb4f4531fc None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.764815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 475/923] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:09:59.771555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5342b-3e4c-4ee6-8f10-d4e740817775 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.771697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:59.771798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5342b-3e4c-4ee6-8f10-d4e740817775 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.771798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5342b-3e4c-4ee6-8f10-d4e740817775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.793163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-10b5342b-3e4c-4ee6-8f10-d4e740817775 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:09:59.795088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-10b5342b-3e4c-4ee6-8f10-d4e740817775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:09:59.859128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:09:59.872931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6d5f-3b36-4dab-bd89-d61232d01817 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:09:59.883021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 476/924] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:09:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:09:59.911289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5342b-3e4c-4ee6-8f10-d4e740817775 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:09:59.920594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:09:59.921444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:09:59.921728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:09:59.922000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:09:59.934392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:09:59.936040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:09:59.954772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:09:59.955673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:09:59.956551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:09:59.956551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:09:59.956551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:09:59.956551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:09:59.961178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 449/925] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:09:59.962368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.021514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5342b-3e4c-4ee6-8f10-d4e740817775 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.048867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:00.061287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.062575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.063104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.063696 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.064713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.066464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.068175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING keystone.server.flask.common [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 10:10:00.069960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642695-e4b8-4e2e-b9f7-12e7df2574c8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.087735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.sql.core [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:10:00.087735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 10:10:00.087735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [parameters: {'id': '583202f6350349e485abce49fab0a364', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 10:10:00.087735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80025) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:10:00.106389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.107101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.107386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.107662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.108437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:00.108746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.110182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 583202f6350349e485abce49fab0a364.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 583202f6350349e485abce49fab0a364. Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:10:00.112334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result.read() Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 30 10:10:00.113133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application yield resource Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise self.value Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application session.commit() Jun 30 10:10:00.114106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:10:00.115038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:10:00.115942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result.read() Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:10:00.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [parameters: {'id': '583202f6350349e485abce49fab0a364', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:00.117624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:00.120653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 583202f6350349e485abce49fab0a364. Jun 30 10:10:00.122864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.126510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 477/926] 10.222.0.44 () {60 vars in 1140 bytes} [Thu Jun 30 10:09:59 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:00.128171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.136525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 450/927] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:00.137983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.176693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:00.254295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61afa-bf7a-4c82-9bf2-e5c7bd4ff1a8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.260137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7fe4-ee98-49ac-8b6b-a39efa3d2dc2 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.293526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.294645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.295073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.295448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.303717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.305106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.307331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.307707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.308177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.308644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.311159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:00.317026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.319167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:10:00.328113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:00.329269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:10:00.330345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:00.332898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 451/928] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:00.340110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:10:00.341318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:00.342169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:00.343101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:00.345819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 478/929] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:00.349433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.468862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:00.469305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ce98a-bc38-48db-bf85-25bb50b9bdb4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.479026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214cff0-40fd-499d-bf05-c6e9362c3214 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.522739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.523718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.524149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.524409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.525313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.525786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.526169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.526551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.526791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:00.527244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.527612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:00.528037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.529138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.529655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.551392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 452/930] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:00.556645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.559197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 479/931] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:00.626006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:00.673615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a452-d9fe-43b3-b0fd-a40ba0b72b6e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.711555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e89728-1e0a-464a-bcfa-470739a54c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.713184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e89728-1e0a-464a-bcfa-470739a54c02 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.713627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e89728-1e0a-464a-bcfa-470739a54c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.714046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e89728-1e0a-464a-bcfa-470739a54c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.725000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e89728-1e0a-464a-bcfa-470739a54c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.726657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e89728-1e0a-464a-bcfa-470739a54c02 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-07e89728-1e0a-464a-bcfa-470739a54c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:00.744741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:00.745871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:00.747020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:00.747020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:00.747020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:00.747020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:00.748974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 453/932] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:00.754344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.777176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be928b69-cca4-46ca-98c2-97564c542c5f None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.777519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be928b69-cca4-46ca-98c2-97564c542c5f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.777741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be928b69-cca4-46ca-98c2-97564c542c5f None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.779218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 454/933] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:00.785504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a521-5454-4642-834e-a8aac2072c6a None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.785792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a521-5454-4642-834e-a8aac2072c6a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.786069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3a521-5454-4642-834e-a8aac2072c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.808761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-23f3a521-5454-4642-834e-a8aac2072c6a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:00.811044 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-23f3a521-5454-4642-834e-a8aac2072c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:00.872912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de762f8-cabf-4732-abf8-3fbe5fbd7eda None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:00.909296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 455/934] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:00.914868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:00.914868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:00.914868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:00.914868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:00.915289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:00.915289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:00.915289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:00.928358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 480/935] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:00.933951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3a521-5454-4642-834e-a8aac2072c6a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.938551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:00.956514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:00.993817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:01.054274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425f6a-3dcd-4949-bd4e-5faed011f2af None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.072296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3a521-5454-4642-834e-a8aac2072c6a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.093039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.094556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.095082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.095757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.096677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.098280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:01.110866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:01.111899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:01.112735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:01.115771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.116565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.116857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.121931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.122436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 481/936] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:01.123560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.124890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.126360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:10:01.145701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:01.146665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:01.147609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:01.152266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 456/937] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:01.154181 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.215492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:01.239465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24857b-38c6-45e7-9bb8-f92dbe9aee1f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.273910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:01.275937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0d18b-ecad-4f82-9451-0f4585d412fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.276799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0d18b-ecad-4f82-9451-0f4585d412fa None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.277086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0d18b-ecad-4f82-9451-0f4585d412fa None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.277326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a263f-936a-470d-bde7-2f491a722ca0 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.277439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0d18b-ecad-4f82-9451-0f4585d412fa None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.278206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0d18b-ecad-4f82-9451-0f4585d412fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:01.278509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0d18b-ecad-4f82-9451-0f4585d412fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.279909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0d18b-ecad-4f82-9451-0f4585d412fa None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.290314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 482/938] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:01.291818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363c6e4-1aff-498f-a40e-2cb6ab19c247 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.292107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363c6e4-1aff-498f-a40e-2cb6ab19c247 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.292406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363c6e4-1aff-498f-a40e-2cb6ab19c247 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.297599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 483/939] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:01.297599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363c6e4-1aff-498f-a40e-2cb6ab19c247 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.317964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4fe41-ae39-4b10-b111-e21a15bc01a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.318526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fe41-ae39-4b10-b111-e21a15bc01a3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.318803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fe41-ae39-4b10-b111-e21a15bc01a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.319084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fe41-ae39-4b10-b111-e21a15bc01a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.319867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4fe41-ae39-4b10-b111-e21a15bc01a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:01.320179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4fe41-ae39-4b10-b111-e21a15bc01a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.322409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4fe41-ae39-4b10-b111-e21a15bc01a3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.334841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 457/940] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:01.336092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6896362-e0a8-4d35-805e-6c9f72033c7b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.336373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6896362-e0a8-4d35-805e-6c9f72033c7b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.336645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6896362-e0a8-4d35-805e-6c9f72033c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.353487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d6896362-e0a8-4d35-805e-6c9f72033c7b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:01.354657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d6896362-e0a8-4d35-805e-6c9f72033c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:01.415395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363c6e4-1aff-498f-a40e-2cb6ab19c247 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.426742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 458/941] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:01.426742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6896362-e0a8-4d35-805e-6c9f72033c7b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.455866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.456537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.456802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.457076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.457777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:01.458084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.459469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.465633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 484/942] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:01.470367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.479065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:01.536676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:01.547443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6896362-e0a8-4d35-805e-6c9f72033c7b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.579714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859751-d12b-4d59-b198-6809a00d5db3 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.584829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.585716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.585999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.586271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/98c15d7378aa4684978de5fc5dd757fd/roles/3b4d675542b74833ab10f0f3cc67f246` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.588566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=98c15d7378aa4684978de5fc5dd757fd, role_id=3b4d675542b74833ab10f0f3cc67f246)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.590093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.614715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 459/943] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:10:01 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/98c15d7378aa4684978de5fc5dd757fd/roles/3b4d675542b74833ab10f0f3cc67f246 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:10:01.614715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.628178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.629230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.629683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.629968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.630883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.632341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:01.647324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:01.648331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 10:10:01.649177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:01.654842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 485/944] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:01.655548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.740526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:01.772227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e71f3-acda-46a3-a341-b51129c3698e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.780039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbd0a0-1027-412d-84c2-6c286f7ec4a1 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.815064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.815752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.816033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.816306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.817266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] RBAC: Adding query filter params (interface=public, service_id=12a2494e817146c08c74b8f8d8cd89e0, region_id=RegionOne) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:01.817633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.819032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.824779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.825454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.825741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.825987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 460/945] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/endpoints?service_id=12a2494e817146c08c74b8f8d8cd89e0&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:01.826108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.826753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:01.827062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.828424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:01.833178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.834991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 486/946] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:01.841647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:01.852131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:01.940957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dc79e-e536-4509-8f31-52b6cf410672 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.967908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513fa50-bf08-4ab3-82bd-e71864a9f58e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:01.991470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:01.992745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:01.994243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:01.995046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:01.995954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:01.998441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:02.005178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75dd95-bcb0-4b8f-969e-715e8d4a38ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:02.005840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dd95-bcb0-4b8f-969e-715e8d4a38ef None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:02.006127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dd95-bcb0-4b8f-969e-715e8d4a38ef None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:02.006407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dd95-bcb0-4b8f-969e-715e8d4a38ef None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:02.007153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 461/947] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:10:02.007260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dd95-bcb0-4b8f-969e-715e8d4a38ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:02.007472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dd95-bcb0-4b8f-969e-715e8d4a38ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:02.008854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dd95-bcb0-4b8f-969e-715e8d4a38ef None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:02.010369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:02.019213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 487/948] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:10:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:02.025373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:02.115636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:02.141983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0263cb-fa24-44b4-9794-23d324a31c56 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:02.179081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e26ee-9ef4-4416-867b-2c4839b07690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:02.180110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e26ee-9ef4-4416-867b-2c4839b07690 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:02.180598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e26ee-9ef4-4416-867b-2c4839b07690 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:02.181705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e26ee-9ef4-4416-867b-2c4839b07690 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:02.182664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e26ee-9ef4-4416-867b-2c4839b07690 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:02.184266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e26ee-9ef4-4416-867b-2c4839b07690 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:02.206251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 462/949] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:10:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:10:02.727922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca090-6805-40f7-bc23-b11323c19814 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:02.728433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca090-6805-40f7-bc23-b11323c19814 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:02.728509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ca090-6805-40f7-bc23-b11323c19814 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:02.730219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 488/950] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:02.735456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41087fcb-cbd4-4087-a69b-88327945e967 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:02.735859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41087fcb-cbd4-4087-a69b-88327945e967 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:02.736045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41087fcb-cbd4-4087-a69b-88327945e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:02.752799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-41087fcb-cbd4-4087-a69b-88327945e967 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:02.753932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-41087fcb-cbd4-4087-a69b-88327945e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:02.830163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 463/951] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:02.855225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ca090-6805-40f7-bc23-b11323c19814 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:02.964757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ca090-6805-40f7-bc23-b11323c19814 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:03.000218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:03.000885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:03.001168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:03.001446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:03.002165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:03.003679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:03.018392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.sql.core [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:10:03.018392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 10:10:03.018392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [parameters: {'user_id': 'b97e64b4147149e7ac769b55b036c5a0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 10:10:03.018392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80025) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result.read() Jun 30 10:10:03.026114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:10:03.027010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application yield resource Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application next(self.gen) Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise self.value Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application session.commit() Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 10:10:03.027950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.session.flush() Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application compat.raise_( Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 10:10:03.029930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 10:10:03.032042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application conn.query(q) Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application result.read() Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 10:10:03.034085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b97e64b4147149e7ac769b55b036c5a0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:03.035977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 30 10:10:03.037018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 30 10:10:03.038202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 30 10:10:03.038202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 30 10:10:03.038202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 10:10:03.038202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 10:10:03.038202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 10:10:03.038202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:03.038202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 489/952] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 30 10:10:02 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:03.038699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41087fcb-cbd4-4087-a69b-88327945e967 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:03.115062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:03.141536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41087fcb-cbd4-4087-a69b-88327945e967 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:03.177545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48bcef-120a-4d22-aec2-daf8f49ce0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:03.178675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48bcef-120a-4d22-aec2-daf8f49ce0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:03.179188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48bcef-120a-4d22-aec2-daf8f49ce0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:03.179657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48bcef-120a-4d22-aec2-daf8f49ce0a9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:03.187878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48bcef-120a-4d22-aec2-daf8f49ce0a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:03.189621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48bcef-120a-4d22-aec2-daf8f49ce0a9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-5a48bcef-120a-4d22-aec2-daf8f49ce0a9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:10:03.205602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:03.206560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 10:10:03.207633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:03.210280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 464/953] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:10:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:03.216121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:03.281423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:03.329325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb89c-2444-4acb-8f67-a39ac4d6a833 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:03.365452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19f3e0-a89f-4e76-8e1b-c5f820f1fb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:03.366131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19f3e0-a89f-4e76-8e1b-c5f820f1fb17 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:03.366417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19f3e0-a89f-4e76-8e1b-c5f820f1fb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:03.366709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19f3e0-a89f-4e76-8e1b-c5f820f1fb17 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:03.367528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19f3e0-a89f-4e76-8e1b-c5f820f1fb17 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:03.367838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19f3e0-a89f-4e76-8e1b-c5f820f1fb17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:03.370038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19f3e0-a89f-4e76-8e1b-c5f820f1fb17 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:03.414544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 490/954] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 30 10:10:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:03.772324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ce5b2-c673-4344-917f-51a367286706 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:03.772868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ce5b2-c673-4344-917f-51a367286706 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:03.772947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ce5b2-c673-4344-917f-51a367286706 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:03.774927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 465/955] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:03.780058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc722e6-79bf-48e6-87ca-06f778bbcd2c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:03.780454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc722e6-79bf-48e6-87ca-06f778bbcd2c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:03.780623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc722e6-79bf-48e6-87ca-06f778bbcd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:03.798292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ffc722e6-79bf-48e6-87ca-06f778bbcd2c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:03.799845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ffc722e6-79bf-48e6-87ca-06f778bbcd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:03.868612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 491/956] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:03.892028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ce5b2-c673-4344-917f-51a367286706 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:03.998276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ce5b2-c673-4344-917f-51a367286706 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.018395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.034540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c831ac3-4158-4f3b-983e-1c71ea44bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.035369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831ac3-4158-4f3b-983e-1c71ea44bae7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.035654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831ac3-4158-4f3b-983e-1c71ea44bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.035987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831ac3-4158-4f3b-983e-1c71ea44bae7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.047579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c831ac3-4158-4f3b-983e-1c71ea44bae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-3c831ac3-4158-4f3b-983e-1c71ea44bae7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:04.055857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:04.056794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:04.057636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.062044 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 466/957] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 30 10:10:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:04.063332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc722e6-79bf-48e6-87ca-06f778bbcd2c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.077306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f64d0-1637-4ade-9e07-f190843c9002 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.077599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f64d0-1637-4ade-9e07-f190843c9002 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.077884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f64d0-1637-4ade-9e07-f190843c9002 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.079411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 467/958] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:10:04.084124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613d62-92e1-498a-aca7-1baed14c55dd None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.084410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613d62-92e1-498a-aca7-1baed14c55dd None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.084687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e613d62-92e1-498a-aca7-1baed14c55dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.101949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4e613d62-92e1-498a-aca7-1baed14c55dd None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:04.103703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4e613d62-92e1-498a-aca7-1baed14c55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:04.117570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.173556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 468/959] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:04.174946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc722e6-79bf-48e6-87ca-06f778bbcd2c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.197945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613d62-92e1-498a-aca7-1baed14c55dd None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.213570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.214857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.215300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.215890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.217093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:04.217566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.219125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.230772 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 492/960] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:04.235945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.302213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e613d62-92e1-498a-aca7-1baed14c55dd None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.313871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.338762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd24c2-0431-422a-a23f-1bda7c2691da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.339596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd24c2-0431-422a-a23f-1bda7c2691da None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.339872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd24c2-0431-422a-a23f-1bda7c2691da None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.340145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd24c2-0431-422a-a23f-1bda7c2691da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.340788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47142d44-9cae-4f5b-9dd3-490b88cbcbdf None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.340911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd24c2-0431-422a-a23f-1bda7c2691da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.342176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd24c2-0431-422a-a23f-1bda7c2691da None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.350747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7cfd24c2-0431-422a-a23f-1bda7c2691da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:04.354222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:04.355819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.357039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 469/961] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:04.360170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c37d-f856-4497-98fd-49d425def8bb None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.360714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c37d-f856-4497-98fd-49d425def8bb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.361179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c37d-f856-4497-98fd-49d425def8bb None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.362473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 470/962] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:04.363339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39c37d-f856-4497-98fd-49d425def8bb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.375261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad015f-3617-47dc-9058-cbb04327447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.376033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad015f-3617-47dc-9058-cbb04327447d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.376313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad015f-3617-47dc-9058-cbb04327447d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.376584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad015f-3617-47dc-9058-cbb04327447d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.387447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad015f-3617-47dc-9058-cbb04327447d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.388889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad015f-3617-47dc-9058-cbb04327447d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-73ad015f-3617-47dc-9058-cbb04327447d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:04.406233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:04.407431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:04.408609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:04.408609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:04.408609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:04.408609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:04.408609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 493/963] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:04.408609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57a31f-ab97-4587-ae3f-618ca8c0a9dd None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.408959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57a31f-ab97-4587-ae3f-618ca8c0a9dd None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.409363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57a31f-ab97-4587-ae3f-618ca8c0a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.428501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6d57a31f-ab97-4587-ae3f-618ca8c0a9dd None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:04.429675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6d57a31f-ab97-4587-ae3f-618ca8c0a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:04.470979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39c37d-f856-4497-98fd-49d425def8bb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.498052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 494/964] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:04.498938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57a31f-ab97-4587-ae3f-618ca8c0a9dd None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.507615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.508274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.508555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.509441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.510147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:04.510449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.511852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.516695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 471/965] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:04.521785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.560942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.594703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.604282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57a31f-ab97-4587-ae3f-618ca8c0a9dd None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.620014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304c7a0-7ef9-47d7-9226-ba83acebc3ba None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.637953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.638612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.638930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.639211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.639928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:04.640238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.641608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.652683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 495/966] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:04.653463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.658524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.659348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.659632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.659932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.660598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.661956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:04.673898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:04.675009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.675855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 472/967] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:04.676654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.756163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25624f-e7ae-4106-843d-2e8f2c0d3d22 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.774933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c7df8-ae5f-4650-8594-e5f9eaa6fd83 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.776856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.789321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.790076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.790435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.790807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.791510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:04.791823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.793173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.798067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 496/968] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:04.799040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.813791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.814532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.814851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.815134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.816961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:04.823884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.825331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:10:04.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:04.840915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:04.841880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 473/969] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:04.842500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.901232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d5957-d48e-4b23-bb56-83f989582f38 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.936412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.937072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.937355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.937640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.938338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:04.938652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.940053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.941495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad1aa0-0e77-4874-998b-b3ff6fa5142e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:04.944834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 497/970] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:04.945602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:04.974128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:04.974800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:04.975081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:04.975348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:04.976077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:04.977432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:04.996579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 474/971] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:10:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:10:04.997401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:05.018728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:05.035949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:05.059844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bac546-0784-45cc-b37b-79cd44bf0864 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:05.107358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:05.107956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:05.108242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:05.108521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:05.109375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:05.109692 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:05.111238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:05.124929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786797-aa1a-41b6-bd75-6fd79c829666 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:05.136305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 498/972] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:05.137879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:05.168302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:05.169872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:05.169872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:05.169872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:05.170221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:05.171138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:05.172451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:05.176832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 475/973] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:10:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:05.257962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61932-55be-48b3-881c-5a33a7ea9030 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:05.299670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:05.300326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:05.300606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:05.300883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:05.303890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:05.376823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:05.378201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:05.481603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 499/974] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:10:05.487346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:05.575885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:05.596060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d7277-8372-417a-a9e9-7175d357402c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:05.630429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:05.631257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:05.631610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:05.631955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:05.644567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:05.644567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:05.662117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:05.663347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:05.664445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:05.664445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:05.664445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:05.664445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:05.669942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 476/975] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:05.671324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:05.706528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:05.774949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1cb2-3c54-40c1-ba93-23362f911347 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:05.809093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:05.809834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:05.810029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:05.810305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:05.811050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:05.811360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:05.812722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:05.824392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 500/976] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:05.829643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:05.929427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d789bf-f166-489f-b5de-3e466ce52dcd None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:05.963562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678d376-5582-4e03-8990-81db30d222da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:05.964350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d376-5582-4e03-8990-81db30d222da None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:05.964632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d376-5582-4e03-8990-81db30d222da None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:05.964909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678d376-5582-4e03-8990-81db30d222da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:05.966826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:05.973044 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678d376-5582-4e03-8990-81db30d222da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:05.974824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678d376-5582-4e03-8990-81db30d222da None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-d678d376-5582-4e03-8990-81db30d222da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:10:05.990079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:05.991208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:05.992140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:05.995024 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 477/977] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:05.997043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:06.090184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:06.097943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa46b-884b-475e-a8f3-4fc6c6c2c807 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:06.133261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdfcad-8cf6-43c1-b790-6369a42f1e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:06.133960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdfcad-8cf6-43c1-b790-6369a42f1e92 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:06.134242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdfcad-8cf6-43c1-b790-6369a42f1e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:06.134517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdfcad-8cf6-43c1-b790-6369a42f1e92 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:06.135339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdfcad-8cf6-43c1-b790-6369a42f1e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:06.135652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdfcad-8cf6-43c1-b790-6369a42f1e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:06.137076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdfcad-8cf6-43c1-b790-6369a42f1e92 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:06.154402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 501/978] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:06.155843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678d376-5582-4e03-8990-81db30d222da None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:06.258880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678d376-5582-4e03-8990-81db30d222da None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:06.296936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf9368-2303-40be-8ed8-3bfcfc3204b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:06.297960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf9368-2303-40be-8ed8-3bfcfc3204b7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:06.298452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf9368-2303-40be-8ed8-3bfcfc3204b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:06.298976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf9368-2303-40be-8ed8-3bfcfc3204b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:06.300036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf9368-2303-40be-8ed8-3bfcfc3204b7 None admin] RBAC: Adding query filter params (role.id=3b4d675542b74833ab10f0f3cc67f246, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=98c15d7378aa4684978de5fc5dd757fd) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:06.300570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf9368-2303-40be-8ed8-3bfcfc3204b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:06.302210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf9368-2303-40be-8ed8-3bfcfc3204b7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:06.314725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 478/979] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:06 2022] GET /identity/v3/role_assignments?user.id=98c15d7378aa4684978de5fc5dd757fd&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=3b4d675542b74833ab10f0f3cc67f246 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:07.040819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe4de-e693-4e2b-9f3a-5d5806b86b41 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.041370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe4de-e693-4e2b-9f3a-5d5806b86b41 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.041370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbe4de-e693-4e2b-9f3a-5d5806b86b41 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.042980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 502/980] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:07.047971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722393b6-8cb2-4e42-b5ac-ea27cc069f00 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.048512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722393b6-8cb2-4e42-b5ac-ea27cc069f00 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.048932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722393b6-8cb2-4e42-b5ac-ea27cc069f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.067187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-722393b6-8cb2-4e42-b5ac-ea27cc069f00 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:07.068880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-722393b6-8cb2-4e42-b5ac-ea27cc069f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:07.125065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:07.140099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 479/981] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:07.162097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe4de-e693-4e2b-9f3a-5d5806b86b41 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:07.222198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd4430-de21-4aa5-8cee-ce00e633849c None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.222491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd4430-de21-4aa5-8cee-ce00e633849c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.222801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd4430-de21-4aa5-8cee-ce00e633849c None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.224169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 480/982] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:07.229913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b5d5a-751f-4c0d-9ecc-cede255e88e9 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.230201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b5d5a-751f-4c0d-9ecc-cede255e88e9 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.230481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b5d5a-751f-4c0d-9ecc-cede255e88e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.248105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-082b5d5a-751f-4c0d-9ecc-cede255e88e9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:07.249306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-082b5d5a-751f-4c0d-9ecc-cede255e88e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:07.270229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbe4de-e693-4e2b-9f3a-5d5806b86b41 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:07.310829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:07.311848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.312287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.312561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.313212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:07.314555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:07.322741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 481/983] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:07.326799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:07.327822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:07.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:07.332830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 503/984] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:10:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:07.333909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b5d5a-751f-4c0d-9ecc-cede255e88e9 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:07.346007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:07.366814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:07.446848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b5d5a-751f-4c0d-9ecc-cede255e88e9 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:07.455354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2fcc2-cf45-4076-af26-45e5171812f4 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:07.466066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:07.489397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:07.489780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.490060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.490334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.491071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:07.491379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:07.492755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:07.497179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:07.497914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.498719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.498841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 482/985] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:07.498938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.499588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:07.501020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:07.503604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:07.518773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 504/986] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:10:07 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:10:07.617710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102e55e-2a6d-40ea-8f54-531925574706 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:07.661069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:07.661524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.661810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.662086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.662828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:07.663141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:07.664521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:07.671226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 483/987] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:07.677030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:07.760531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:07.784186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a88d3-5f13-4431-9068-6e4636730fda None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:07.817987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76648ff9-ddfd-457d-8617-93c82a6cfd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:07.818649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76648ff9-ddfd-457d-8617-93c82a6cfd35 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.818964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76648ff9-ddfd-457d-8617-93c82a6cfd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.819245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76648ff9-ddfd-457d-8617-93c82a6cfd35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.820041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76648ff9-ddfd-457d-8617-93c82a6cfd35 None admin] RBAC: Adding query filter params (interface=admin, service_id=12a2494e817146c08c74b8f8d8cd89e0, region_id=RegionOne) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:07.820357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76648ff9-ddfd-457d-8617-93c82a6cfd35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:07.822303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76648ff9-ddfd-457d-8617-93c82a6cfd35 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:07.827634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 505/988] 10.222.0.44 () {56 vars in 1249 bytes} [Thu Jun 30 10:10:07 2022] GET /identity/v3/endpoints?service_id=12a2494e817146c08c74b8f8d8cd89e0&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:07.832915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:07.877382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:07.935934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5524b-fc91-4bfc-b0fc-254774a8bd26 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:07.970946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45ab2-1adc-4fef-9e4a-c0c69095b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:07.971616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45ab2-1adc-4fef-9e4a-c0c69095b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:07.971900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45ab2-1adc-4fef-9e4a-c0c69095b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:07.972178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45ab2-1adc-4fef-9e4a-c0c69095b4a6 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:07.972859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45ab2-1adc-4fef-9e4a-c0c69095b4a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:07.974248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45ab2-1adc-4fef-9e4a-c0c69095b4a6 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:07.981269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 484/989] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:10:07 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:10:08.386924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c107-51ac-4197-b5ec-b729e10320c0 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:08.387450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c107-51ac-4197-b5ec-b729e10320c0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:08.387450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146c107-51ac-4197-b5ec-b729e10320c0 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:08.389004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 506/990] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:08.393942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416451df-f93b-4eda-bd43-75196067ed5e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:08.394323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416451df-f93b-4eda-bd43-75196067ed5e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:08.394517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416451df-f93b-4eda-bd43-75196067ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:08.411394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-416451df-f93b-4eda-bd43-75196067ed5e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:08.412563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-416451df-f93b-4eda-bd43-75196067ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:08.494956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 485/991] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:08.512724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c107-51ac-4197-b5ec-b729e10320c0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:08.616455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146c107-51ac-4197-b5ec-b729e10320c0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:08.653366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:08.654155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:08.654434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:08.654884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] PATH_INFO: `/v3/services/image` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:08.655647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:08.657677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:08.671652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:08.672658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:08.673477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:08.674883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 507/992] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 30 10:10:08 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:08.678878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416451df-f93b-4eda-bd43-75196067ed5e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:08.714676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:08.780560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416451df-f93b-4eda-bd43-75196067ed5e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:08.813927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237879-9bb6-42f9-9c65-cec7d54c9299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:08.814582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237879-9bb6-42f9-9c65-cec7d54c9299 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:08.814894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237879-9bb6-42f9-9c65-cec7d54c9299 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:08.815168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237879-9bb6-42f9-9c65-cec7d54c9299 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:08.815855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237879-9bb6-42f9-9c65-cec7d54c9299 None admin] RBAC: Adding query filter params (name=image) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:08.816156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237879-9bb6-42f9-9c65-cec7d54c9299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:08.817510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237879-9bb6-42f9-9c65-cec7d54c9299 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:08.822661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 486/993] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:08.828078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:08.837841 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:08.929566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f16f0-c6dc-4399-8749-593824a33924 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:08.965696 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091bebf-9d4f-41c6-b2e7-6fe7f2f06482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:08.966585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091bebf-9d4f-41c6-b2e7-6fe7f2f06482 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:08.967058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091bebf-9d4f-41c6-b2e7-6fe7f2f06482 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:08.967477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091bebf-9d4f-41c6-b2e7-6fe7f2f06482 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:08.968326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091bebf-9d4f-41c6-b2e7-6fe7f2f06482 None admin] RBAC: Adding query filter params (type=image) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:08.968773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091bebf-9d4f-41c6-b2e7-6fe7f2f06482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:08.970292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091bebf-9d4f-41c6-b2e7-6fe7f2f06482 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:08.975273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 508/994] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:09.557840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680baa4-2400-48ff-ba31-069f4c735418 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:09.558353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680baa4-2400-48ff-ba31-069f4c735418 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:09.558469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680baa4-2400-48ff-ba31-069f4c735418 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:09.559923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 487/995] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:09.564930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef028b0-4a0d-4c17-a5fc-e13f2ed7db6f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:09.565308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef028b0-4a0d-4c17-a5fc-e13f2ed7db6f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:09.565489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef028b0-4a0d-4c17-a5fc-e13f2ed7db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:09.582834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bef028b0-4a0d-4c17-a5fc-e13f2ed7db6f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:09.584025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bef028b0-4a0d-4c17-a5fc-e13f2ed7db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:09.648442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:09.654731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 509/996] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:09.677401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680baa4-2400-48ff-ba31-069f4c735418 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:09.778770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:09.784054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680baa4-2400-48ff-ba31-069f4c735418 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:09.817719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9503d-64b8-40fd-a27a-d0d2e56851b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:09.818505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9503d-64b8-40fd-a27a-d0d2e56851b4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:09.818814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9503d-64b8-40fd-a27a-d0d2e56851b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:09.819091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9503d-64b8-40fd-a27a-d0d2e56851b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:09.819735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9503d-64b8-40fd-a27a-d0d2e56851b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:09.821171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9503d-64b8-40fd-a27a-d0d2e56851b4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-39e9503d-64b8-40fd-a27a-d0d2e56851b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:09.833194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:09.834157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:09.835346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:09.838750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 488/997] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:09.840600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef028b0-4a0d-4c17-a5fc-e13f2ed7db6f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:09.947297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef028b0-4a0d-4c17-a5fc-e13f2ed7db6f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:09.987413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:09.990706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:09.990706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:09.990706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:09.990706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:09.990706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:09.991461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:09.999521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e873-a384-4242-9c76-4101cba59b95 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.002707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e873-a384-4242-9c76-4101cba59b95 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.002707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e873-a384-4242-9c76-4101cba59b95 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.003165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 510/998] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:10:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:10.003165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:10.006110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 489/999] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:10.006316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f80c7-e66e-4b6a-aa46-ca8f4e29ad10 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.008206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f80c7-e66e-4b6a-aa46-ca8f4e29ad10 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.008206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f80c7-e66e-4b6a-aa46-ca8f4e29ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.039056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ae6f80c7-e66e-4b6a-aa46-ca8f4e29ad10 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:10.040210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ae6f80c7-e66e-4b6a-aa46-ca8f4e29ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:10.072816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:10.116034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397479f-1ccd-46c7-915b-de352be7ee48 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:10.118755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 490/1000] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:10.145381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f80c7-e66e-4b6a-aa46-ca8f4e29ad10 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:10.162768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:10.163427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.163815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.163968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.165515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:10.165515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:10.166873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:10.173169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 511/1001] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:10:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:10.177877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:10.287008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:10.292126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fbd1f-6461-46fc-b17b-452bb7cb0e75 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:10.296499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f80c7-e66e-4b6a-aa46-ca8f4e29ad10 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:10.321735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:10.330183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:10.330866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.331149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.331423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.332201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] RBAC: Adding query filter params (interface=public, service_id=cb1d24f81eb44d9e9fc688a660674579, region_id=RegionOne) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:10.332503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:10.333077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:10.333858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:10.333968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.334133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.334401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.335072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:10.336428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:10.339345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 512/1002] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:10:10 2022] GET /identity/v3/endpoints?service_id=cb1d24f81eb44d9e9fc688a660674579&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:10.344297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:10.353397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:10.354468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:10.355360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 491/1003] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 30 10:10:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:10.360311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:10.450441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4892ee1-e832-4a86-af17-ebd383720c13 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:10.466556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c24132-a68a-4f5a-8b5f-92a43492f7f8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:10.488217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:10.489253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.489253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.489394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.490073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:10.491479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:10.497950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 513/1004] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:10:10 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:10:10.513416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:10.514114 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.514394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.514665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.515423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:10.515728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:10.517155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:10.523095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 492/1005] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:10.529325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:10.592676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:10.639552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3f6cb-70e3-48e4-87f8-5229572a97f4 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:10.677642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822289e-76c7-4c9b-bc5b-17b833939b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:10.678305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822289e-76c7-4c9b-bc5b-17b833939b34 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.678588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822289e-76c7-4c9b-bc5b-17b833939b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.678896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822289e-76c7-4c9b-bc5b-17b833939b34 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.679601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822289e-76c7-4c9b-bc5b-17b833939b34 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:10.679908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822289e-76c7-4c9b-bc5b-17b833939b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:10.681442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822289e-76c7-4c9b-bc5b-17b833939b34 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:10.689430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 514/1006] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 30 10:10:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:10.694976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:10.721538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:10.800355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9853e05-c06b-4b8d-99fc-30a93019d6f3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:10.834533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c260072-2678-439b-83bc-2d5cd4d96198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:10.835226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260072-2678-439b-83bc-2d5cd4d96198 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:10.835507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260072-2678-439b-83bc-2d5cd4d96198 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:10.835781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c260072-2678-439b-83bc-2d5cd4d96198 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:10.836526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260072-2678-439b-83bc-2d5cd4d96198 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:10.838480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c260072-2678-439b-83bc-2d5cd4d96198 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:10.853944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 493/1007] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:10:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:10:11.026247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861e22d-e521-443c-8656-0c27f73e8ac0 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:11.026549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861e22d-e521-443c-8656-0c27f73e8ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:11.026843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861e22d-e521-443c-8656-0c27f73e8ac0 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:11.028238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 515/1008] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:11.033663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb9815-06aa-4a5b-8412-0e2e75c0dc52 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:11.033953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb9815-06aa-4a5b-8412-0e2e75c0dc52 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:11.034232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb9815-06aa-4a5b-8412-0e2e75c0dc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:11.051010 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-99fb9815-06aa-4a5b-8412-0e2e75c0dc52 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:11.052196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-99fb9815-06aa-4a5b-8412-0e2e75c0dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:11.127783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 494/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:11.151154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861e22d-e521-443c-8656-0c27f73e8ac0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:11.253225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861e22d-e521-443c-8656-0c27f73e8ac0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:11.273406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:11.287836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffd8bd-80f0-404e-b1d2-c875c73b3013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:11.288499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffd8bd-80f0-404e-b1d2-c875c73b3013 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:11.288786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffd8bd-80f0-404e-b1d2-c875c73b3013 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:11.289064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffd8bd-80f0-404e-b1d2-c875c73b3013 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:11.289802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffd8bd-80f0-404e-b1d2-c875c73b3013 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:11.291195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffd8bd-80f0-404e-b1d2-c875c73b3013 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:11.306498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 516/1010] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:10:11 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:10:12.517945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e03f7-4104-41f0-9fb9-e06580075187 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:12.518448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e03f7-4104-41f0-9fb9-e06580075187 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:12.518535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e03f7-4104-41f0-9fb9-e06580075187 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:12.520054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 495/1011] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:12.524955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeed4c-0cd7-4427-b4cf-88dc8631125a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:12.525369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeed4c-0cd7-4427-b4cf-88dc8631125a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:12.525547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aeed4c-0cd7-4427-b4cf-88dc8631125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:12.542766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-42aeed4c-0cd7-4427-b4cf-88dc8631125a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:12.543936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-42aeed4c-0cd7-4427-b4cf-88dc8631125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:12.616374 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 517/1012] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:12.639105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e03f7-4104-41f0-9fb9-e06580075187 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:12.649762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:12.742322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e03f7-4104-41f0-9fb9-e06580075187 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:12.776470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148bfe2-182e-4fff-9bf6-8d6d5ae61bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:12.777273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148bfe2-182e-4fff-9bf6-8d6d5ae61bfb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:12.777562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148bfe2-182e-4fff-9bf6-8d6d5ae61bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:12.777839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148bfe2-182e-4fff-9bf6-8d6d5ae61bfb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:12.778493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148bfe2-182e-4fff-9bf6-8d6d5ae61bfb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:12.779913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148bfe2-182e-4fff-9bf6-8d6d5ae61bfb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-2148bfe2-182e-4fff-9bf6-8d6d5ae61bfb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:12.792353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:12.793430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 10:10:12.794378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:12.796028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 496/1013] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:12.799537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeed4c-0cd7-4427-b4cf-88dc8631125a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:12.898234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aeed4c-0cd7-4427-b4cf-88dc8631125a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:12.906993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:12.926207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadaee-7338-4941-b7ef-62c61075fb9e None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:12.926497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadaee-7338-4941-b7ef-62c61075fb9e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:12.926807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cadaee-7338-4941-b7ef-62c61075fb9e None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:12.928430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 497/1014] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:12.933262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51989b-24ec-4248-aa79-74583f3a7077 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:12.933555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51989b-24ec-4248-aa79-74583f3a7077 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:12.933822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51989b-24ec-4248-aa79-74583f3a7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:12.936930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:12.937594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:12.937879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:12.938162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:12.938907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] RBAC: Adding query filter params (name=compute) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:12.939218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:12.940593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:12.945571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 518/1015] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:10:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:12.952262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:12.956461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6d51989b-24ec-4248-aa79-74583f3a7077 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:12.957660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6d51989b-24ec-4248-aa79-74583f3a7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:13.037257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 498/1016] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:13.060297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc1129-4eb2-4e80-8060-b9419d840bda None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:13.060915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51989b-24ec-4248-aa79-74583f3a7077 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:13.063887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:13.099243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:13.099909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.100195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.100501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.101848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:13.101848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:13.103515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:13.113330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 519/1017] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 30 10:10:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:13.115421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:13.151157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:13.174066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51989b-24ec-4248-aa79-74583f3a7077 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:13.210955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:13.212299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.212580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.212875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.214023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:13.215489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:13.217288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 499/1018] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:13.222636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:13.223036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9c9f8-fe89-4c81-81fc-cc56ea538bb4 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:13.261614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db745d3-6c5e-40fc-a6dc-2d4415b81556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:13.262265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db745d3-6c5e-40fc-a6dc-2d4415b81556 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.262544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db745d3-6c5e-40fc-a6dc-2d4415b81556 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.262847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db745d3-6c5e-40fc-a6dc-2d4415b81556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.263590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db745d3-6c5e-40fc-a6dc-2d4415b81556 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:13.264931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db745d3-6c5e-40fc-a6dc-2d4415b81556 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:13.294837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 520/1019] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:10:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:10:13.308236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:13.351567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39523-0315-4082-9f05-54af166a33b8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:13.352113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a5684-ceef-444a-a371-b10faa3c389b None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.352402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a5684-ceef-444a-a371-b10faa3c389b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.352680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a5684-ceef-444a-a371-b10faa3c389b None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.355825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 521/1020] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:10:13.362301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049025-f70e-4700-91a2-3f2f1d256ef3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.362616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049025-f70e-4700-91a2-3f2f1d256ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.362900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de049025-f70e-4700-91a2-3f2f1d256ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.387627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-de049025-f70e-4700-91a2-3f2f1d256ef3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:13.390056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-de049025-f70e-4700-91a2-3f2f1d256ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:13.402908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:13.403578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.403861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.404136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.404852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:13.406337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:13.442713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 500/1021] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:10:13 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:10:13.482731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 522/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:13.507418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:13.620094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17bdbb-ced6-44b9-91c1-6e51167a7ef4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:13.638338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:13.656664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:13.657461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.657747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.658020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] PATH_INFO: `/v3/services/image` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.658669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:13.660104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:13.671896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:13.672918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:13.673895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 501/1023] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 30 10:10:13 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:13.679302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de049025-f70e-4700-91a2-3f2f1d256ef3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:13.702793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:13.789488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de049025-f70e-4700-91a2-3f2f1d256ef3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:13.825274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:13.825942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.826224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.826498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.827296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] RBAC: Adding query filter params (name=image) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:13.827606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:13.829030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:13.838603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 523/1024] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:13.839570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:13.941141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c1d49-abd0-4637-8382-c6ebe866123d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:13.976097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:13.976765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:13.977096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:13.977907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:13.978607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] RBAC: Adding query filter params (type=image) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:13.978944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:13.980319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:13.985504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 502/1025] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:13.991139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:14.075927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:14.096520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd634f7-f519-4b77-94a3-8ae7374ed15a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:14.131227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76509a-57f6-4b9f-8099-4348577a249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:14.131888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76509a-57f6-4b9f-8099-4348577a249d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:14.132169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76509a-57f6-4b9f-8099-4348577a249d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:14.132444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76509a-57f6-4b9f-8099-4348577a249d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:14.133232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76509a-57f6-4b9f-8099-4348577a249d None admin] RBAC: Adding query filter params (interface=public, service_id=7aa294e67fc3451db30c20e4b3e42a50, region_id=RegionOne) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:14.133581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76509a-57f6-4b9f-8099-4348577a249d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:14.134965 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76509a-57f6-4b9f-8099-4348577a249d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:14.144608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 524/1026] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:10:13 2022] GET /identity/v3/endpoints?service_id=7aa294e67fc3451db30c20e4b3e42a50&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:14.145800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:14.196034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:14.252106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37da98-6405-49f3-b169-4c3804c6364a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:14.284986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3730c1-d076-4e19-bdab-4e4a4f7ffb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:14.285636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3730c1-d076-4e19-bdab-4e4a4f7ffb9d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:14.285914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3730c1-d076-4e19-bdab-4e4a4f7ffb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:14.286187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3730c1-d076-4e19-bdab-4e4a4f7ffb9d None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:14.286882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3730c1-d076-4e19-bdab-4e4a4f7ffb9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:14.288247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3730c1-d076-4e19-bdab-4e4a4f7ffb9d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:14.295532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 503/1027] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:10:14 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:10:15.492146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35b9d-1b4e-45b7-84e8-1e97507d0114 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.492568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35b9d-1b4e-45b7-84e8-1e97507d0114 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.492748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35b9d-1b4e-45b7-84e8-1e97507d0114 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.494848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 525/1028] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:15.499660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e6cf-ff6a-4968-a4f5-3629c4feaec0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.500040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e6cf-ff6a-4968-a4f5-3629c4feaec0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.500216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e6cf-ff6a-4968-a4f5-3629c4feaec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.517072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b8b4e6cf-ff6a-4968-a4f5-3629c4feaec0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:15.518260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b8b4e6cf-ff6a-4968-a4f5-3629c4feaec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:15.549368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90814-326d-40a7-90a2-b513515a2057 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.549656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90814-326d-40a7-90a2-b513515a2057 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.549935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90814-326d-40a7-90a2-b513515a2057 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.551328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 526/1029] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:15.556839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1e4-c4e3-4293-9afa-66274ec8aece None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.557126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1e4-c4e3-4293-9afa-66274ec8aece None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.557406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe1e4-c4e3-4293-9afa-66274ec8aece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.574358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-701fe1e4-c4e3-4293-9afa-66274ec8aece None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:15.575576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-701fe1e4-c4e3-4293-9afa-66274ec8aece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:15.592507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 504/1030] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:15.615990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e6cf-ff6a-4968-a4f5-3629c4feaec0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:15.643840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 527/1031] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:15.656791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:15.668514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe1e4-c4e3-4293-9afa-66274ec8aece None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:15.718513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e6cf-ff6a-4968-a4f5-3629c4feaec0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:15.745805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:15.759460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:15.760297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.760592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.760852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.771089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe1e4-c4e3-4293-9afa-66274ec8aece None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:15.771532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:15.779681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:15.780637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:15.782213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 505/1032] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 30 10:10:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:15.786633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:15.808415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:15.809494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.809788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.810068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.811294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:15.813181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:15.815307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 528/1033] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:15.820445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:15.895993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:15.899893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718d08-5475-4de7-82c5-4cf5aeacd053 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:15.932287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee65b3-7e1c-42d0-8485-40b3e6a236b8 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:15.936756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:15.937486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.937771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.938046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.938813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:15.939122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:15.940500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:15.950737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 506/1034] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 30 10:10:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:15.955957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:15.970453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:15.971438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:15.971729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:15.972005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:15.972722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:15.974146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:15.998928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 529/1035] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:10:15 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:10:16.075529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31ed55-7017-467c-89c6-a4765dbe585a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.122028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46c70e-29f5-4f37-948d-8abc384f238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.122874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c70e-29f5-4f37-948d-8abc384f238b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.123159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c70e-29f5-4f37-948d-8abc384f238b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.123433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c70e-29f5-4f37-948d-8abc384f238b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.135847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46c70e-29f5-4f37-948d-8abc384f238b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.137338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46c70e-29f5-4f37-948d-8abc384f238b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-9a46c70e-29f5-4f37-948d-8abc384f238b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:16.155739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:16.156688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:16.157842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:16.157842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:16.157842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:16.157842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:16.157842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 507/1036] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:16.162750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:16.166182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:16.269999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e1982-53c9-49f3-89c8-945fcfb1d590 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.304750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433559-8af9-4cc1-b90c-69abeebd5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.306006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433559-8af9-4cc1-b90c-69abeebd5a52 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.306271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433559-8af9-4cc1-b90c-69abeebd5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.306549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433559-8af9-4cc1-b90c-69abeebd5a52 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.307306 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433559-8af9-4cc1-b90c-69abeebd5a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:16.307615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433559-8af9-4cc1-b90c-69abeebd5a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.308988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24433559-8af9-4cc1-b90c-69abeebd5a52 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.319683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a92810-73c5-44bd-a7ae-be0c97845fc2 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.319947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a92810-73c5-44bd-a7ae-be0c97845fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.320226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a92810-73c5-44bd-a7ae-be0c97845fc2 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.321969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 530/1037] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:16.322077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 508/1038] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:10:16.326994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966502-2bff-40fd-8480-142f8e7a1987 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.327280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966502-2bff-40fd-8480-142f8e7a1987 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.327528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a92810-73c5-44bd-a7ae-be0c97845fc2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:16.327634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966502-2bff-40fd-8480-142f8e7a1987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.343089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-08966502-2bff-40fd-8480-142f8e7a1987 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:16.344257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-08966502-2bff-40fd-8480-142f8e7a1987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:16.344984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:16.402729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:16.416023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 531/1039] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:16.439096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08966502-2bff-40fd-8480-142f8e7a1987 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:16.440084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a92810-73c5-44bd-a7ae-be0c97845fc2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.478989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.479783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.480770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.480770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.489594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.491318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:10:16.507222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:16.508580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:10:16.509542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:16.516643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 509/1040] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:10:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:16.517698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:16.551833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08966502-2bff-40fd-8480-142f8e7a1987 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.589235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.590017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.590299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.590574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] PATH_INFO: `/v3/services/image` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.591260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.592711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:16.605281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:16.606475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 10:10:16.608085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:16.609008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:16.609096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 532/1041] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 30 10:10:16 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:16.612550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:16.638746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35668364-d0b4-4d5d-93e0-7cabc4800e72 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.672237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:16.672869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.673537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.673904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.674317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.675452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:16.675761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.677192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.694219 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 510/1042] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:10:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:16.700785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:16.726300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321d0d-26f0-4bac-bb65-c498fa3638ee None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.762880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.763545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.763831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.764227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.765045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:16.765365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.766755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.772171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 533/1043] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:16.778110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:16.801079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19068f-1dc7-4151-baa0-ef8c04163d8a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.833139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:16.840115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.840766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.841046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.841323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.886580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1757-14f8-4e83-9130-843d4a7bc1d6 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:16.907828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:16.918027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.919728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.930437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:16.931410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:16.931915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:16.932395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:16.933373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] RBAC: Adding query filter params (type=image) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:16.933784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:16.935179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:16.940355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 534/1044] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:16.945791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:17.027695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 511/1045] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:10:17.028733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:17.054509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e00b5-fde7-40fa-bcc8-5f2457ef7a53 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:17.060932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:17.088790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:17.089472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:17.089924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:17.090268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:17.091200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:17.092598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:17.122723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 535/1046] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:10:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:10:17.153441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bc7bb-3583-4b6c-96fc-05cad3784db9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:17.202040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:17.202901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:17.203178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:17.203451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:17.215563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:17.217064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:17.236104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:17.237104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:17.238131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:17.238131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:17.238131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:17.238131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:17.239172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 512/1047] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:17.243938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:17.289229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:17.350200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99286db2-e744-41ac-9c72-f5ba900b8052 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:17.385747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:17.386414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:17.386722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:17.387008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:17.387735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:17.388046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:17.389428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:17.401533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 536/1048] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:17.406898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:17.510124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:17.531150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827f48-d380-4bb6-a1c6-f740993206fb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:17.566031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:17.566857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:17.567132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:17.567408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:17.575103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:17.576557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:10:17.590247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:17.591345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:17.592357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:17.594749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 513/1049] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:17.597287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:17.701122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:17.704250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64877f-149b-4ade-bca3-33a9c807fe78 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:17.740452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99597dba-8222-4f0a-bc2e-37c9483f2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:17.741117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99597dba-8222-4f0a-bc2e-37c9483f2c29 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:17.741404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99597dba-8222-4f0a-bc2e-37c9483f2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:17.741684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99597dba-8222-4f0a-bc2e-37c9483f2c29 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:17.742467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99597dba-8222-4f0a-bc2e-37c9483f2c29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:17.743358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99597dba-8222-4f0a-bc2e-37c9483f2c29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:17.744797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99597dba-8222-4f0a-bc2e-37c9483f2c29 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:17.761113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 537/1050] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:17.762347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:17.864670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd9190-b5fc-4e78-b199-4f9942ff4eb9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:17.898993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc61291-82c2-4eb2-ae69-744d2d979ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:17.899648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61291-82c2-4eb2-ae69-744d2d979ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:17.899936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61291-82c2-4eb2-ae69-744d2d979ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:17.900214 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61291-82c2-4eb2-ae69-744d2d979ad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:17.901040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc61291-82c2-4eb2-ae69-744d2d979ad0 None admin] RBAC: Adding query filter params (role.id=3b4d675542b74833ab10f0f3cc67f246, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=a8c2616d20ea41f7ad4f953138f5636e) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:17.901354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc61291-82c2-4eb2-ae69-744d2d979ad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:17.902817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc61291-82c2-4eb2-ae69-744d2d979ad0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:17.915059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 514/1051] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:17 2022] GET /identity/v3/role_assignments?user.id=a8c2616d20ea41f7ad4f953138f5636e&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=3b4d675542b74833ab10f0f3cc67f246 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:18.105025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b3cd9-9433-4ba1-a613-453bbf9a1ab4 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:18.105332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b3cd9-9433-4ba1-a613-453bbf9a1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:18.105500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b3cd9-9433-4ba1-a613-453bbf9a1ab4 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:18.106945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 538/1052] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:18.111969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902dcae-0d2f-480c-bd91-ac4609bb3aef None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:18.112325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902dcae-0d2f-480c-bd91-ac4609bb3aef None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:18.112671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902dcae-0d2f-480c-bd91-ac4609bb3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:18.118723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:18.130484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4902dcae-0d2f-480c-bd91-ac4609bb3aef None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:18.131702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4902dcae-0d2f-480c-bd91-ac4609bb3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:18.200856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 515/1053] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:18.223947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b3cd9-9433-4ba1-a613-453bbf9a1ab4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:18.328023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b3cd9-9433-4ba1-a613-453bbf9a1ab4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:18.361877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:18.362581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:18.362890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:18.363164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:18.374957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:18.382311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:18.383445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:18.384282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:18.388616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 539/1054] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:18.389467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902dcae-0d2f-480c-bd91-ac4609bb3aef None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:18.495760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902dcae-0d2f-480c-bd91-ac4609bb3aef None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:18.529059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:18.529707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:18.529985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:18.530255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:18.531026 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:18.531329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:18.532694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:18.534057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:18.543313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 516/1055] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:18.548744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:18.570756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:18.649454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f1c1-5800-4615-b144-d3226a8917fb None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:18.683113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:18.683961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:18.684239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:18.684507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] PATH_INFO: `/v3/users/31bf42035c454579947923b954f90631` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:18.697657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] RBAC: Authorizing `identity:get_user(user_id=31bf42035c454579947923b954f90631)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:18.699111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:18.700919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 540/1056] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:18 2022] GET /identity/v3/users/31bf42035c454579947923b954f90631 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:18.706349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:18.804739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f754cc-7d5c-4108-93a8-70d006f5626e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:18.837947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:18.838590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:18.838900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:18.839172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:18.899634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:18.907580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:18.909039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:19.015613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 517/1057] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:10:19.021101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:19.110768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:19.132868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257f56-3048-4e72-9bb2-5524c7b528af None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:19.166934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f896e86-f629-4756-8619-b136d5e38b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:19.167702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f896e86-f629-4756-8619-b136d5e38b74 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.167977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f896e86-f629-4756-8619-b136d5e38b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.168247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f896e86-f629-4756-8619-b136d5e38b74 None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.169409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f896e86-f629-4756-8619-b136d5e38b74 None admin] RBAC: Authorizing `identity:get_project(project_id=e2953c13dad84373a16c4af2bcdca36d)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:19.170885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f896e86-f629-4756-8619-b136d5e38b74 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:19.172764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 541/1058] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:19 2022] GET /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:19.178522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:19.208324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f1f9c-548c-4b23-9c3f-3fc02b2efc8b None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.208633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f1f9c-548c-4b23-9c3f-3fc02b2efc8b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.208883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f1f9c-548c-4b23-9c3f-3fc02b2efc8b None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.210244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 542/1059] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:10:19.215869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4008b-0512-40a7-8b4e-797a33323269 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.216153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4008b-0512-40a7-8b4e-797a33323269 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.216426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4008b-0512-40a7-8b4e-797a33323269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.233667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-95d4008b-0512-40a7-8b4e-797a33323269 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:19.235097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-95d4008b-0512-40a7-8b4e-797a33323269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:19.277878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:19.284051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89868a31-90d9-452b-9d8f-4e37838b89a3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:19.317031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:19.317551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 543/1060] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:19.317695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.317955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.318483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.319343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=e2953c13dad84373a16c4af2bcdca36d, user.id=31bf42035c454579947923b954f90631) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:19.319654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:19.321876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:19.327179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 518/1061] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:19 2022] GET /identity/v3/role_assignments?user.id=31bf42035c454579947923b954f90631&scope.project.id=e2953c13dad84373a16c4af2bcdca36d&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:19.336335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4008b-0512-40a7-8b4e-797a33323269 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:19.435233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:19.462331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4008b-0512-40a7-8b4e-797a33323269 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:19.504206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:19.504858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.505137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.505410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.572654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:19.574106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:19.648754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:19.677646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 544/1062] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:10:19.679777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:19.779922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa8e70-572b-4cc4-9efd-6f0591dec585 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:19.813642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ccfd0-0bc8-4d49-85dd-c53f9d3de445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:19.814426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccfd0-0bc8-4d49-85dd-c53f9d3de445 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.814716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccfd0-0bc8-4d49-85dd-c53f9d3de445 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.814993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ccfd0-0bc8-4d49-85dd-c53f9d3de445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.825838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ccfd0-0bc8-4d49-85dd-c53f9d3de445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:19.827319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ccfd0-0bc8-4d49-85dd-c53f9d3de445 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-056ccfd0-0bc8-4d49-85dd-c53f9d3de445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:19.844368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:19.845245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:19.851030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:19.851030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:19.851030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:19.851030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:19.851030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 519/1063] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:19.853242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:19.950452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01356-e290-4c28-ad20-0bb3fefc6400 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:19.951887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685774-50bf-4d17-9373-9084bc84dfce None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.952183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685774-50bf-4d17-9373-9084bc84dfce None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.952520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685774-50bf-4d17-9373-9084bc84dfce None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.953972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 520/1064] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:19.958773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0895-4659-45de-9395-39b5aa72b189 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.959068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0895-4659-45de-9395-39b5aa72b189 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.959351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc0895-4659-45de-9395-39b5aa72b189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.976592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-52bc0895-4659-45de-9395-39b5aa72b189 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:19.978298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-52bc0895-4659-45de-9395-39b5aa72b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:19.984975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:19.985638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:19.985774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:19.985915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:19.986565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:19.987445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:19.987757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:19.989228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:20.001282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 545/1065] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:20.057140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 521/1066] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:20.079877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:20.121556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:20.193833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5607c-e919-434a-a439-9f47bbcb8aae None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:20.228474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:20.229278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:20.229557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:20.229828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:20.240282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:20.248889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:20.249824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:20.250709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 546/1067] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 30 10:10:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:20.256689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0895-4659-45de-9395-39b5aa72b189 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:20.358921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc0895-4659-45de-9395-39b5aa72b189 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:20.392211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:20.392875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:20.393160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:20.393435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:20.394186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:20.394492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:20.395941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:20.404546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 522/1068] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 30 10:10:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:20.410315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:20.506085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:20.512249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f6eed-3bac-41f1-8c8c-9c441caa97e3 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:20.545364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:20.546140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:20.546423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:20.546707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:20.556865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:20.558294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:20.575070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:20.575935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:20.576831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:20.576831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:20.576831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:20.576831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:20.578823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 547/1069] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:20.582221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:20.585994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:20.680189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca5d33-feb3-4289-981b-e09cefc9ca0a None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:20.713419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:20.714062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:20.714345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:20.714619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:20.715360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:20.715665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:20.717029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:20.728428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 523/1070] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:20.734297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:20.831402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33625b-41b6-44dd-b4a5-17aad8b5cc5d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:20.863806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:20.864582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:20.864862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:20.865131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:20.872481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:20.873915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:10:20.887987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:20.889082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:20.890058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 548/1071] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:10:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:20.894937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:20.955479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:20.992264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b8e35-3965-44ac-ad85-b051806e404e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.025736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.026401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.026707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.026984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.027815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:21.028125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.029560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.047390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 524/1072] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:10:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:21.052970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.064828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:21.151923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed403f1-40f7-4148-96e2-c7c5837c3828 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.184591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001f6d2-c86c-48be-82b7-191d3777799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.185376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f6d2-c86c-48be-82b7-191d3777799f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.185650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f6d2-c86c-48be-82b7-191d3777799f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.185919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001f6d2-c86c-48be-82b7-191d3777799f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.196887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001f6d2-c86c-48be-82b7-191d3777799f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.198311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001f6d2-c86c-48be-82b7-191d3777799f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-3001f6d2-c86c-48be-82b7-191d3777799f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:21.215389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:21.216358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:21.217273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:21.217273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:21.217273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:21.217273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:21.217273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 549/1073] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:21.222140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.323348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bac4-2733-4378-91d1-3d4ba4eca100 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.341468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98aec1-8dfe-41fb-b2e2-d9c57c50c6d3 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.341752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98aec1-8dfe-41fb-b2e2-d9c57c50c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.342027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98aec1-8dfe-41fb-b2e2-d9c57c50c6d3 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.343433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 550/1074] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:10:21.345623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:21.348336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab262491-d0ab-46a4-929c-16ef7a1e732f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.348620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab262491-d0ab-46a4-929c-16ef7a1e732f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.348897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab262491-d0ab-46a4-929c-16ef7a1e732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.358111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.358796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.359082 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.359356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.360072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:21.360376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.361750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.366043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ab262491-d0ab-46a4-929c-16ef7a1e732f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:21.367235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ab262491-d0ab-46a4-929c-16ef7a1e732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:21.373532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 525/1075] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:21.385053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.425248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:21.438394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 551/1076] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:21.460708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab262491-d0ab-46a4-929c-16ef7a1e732f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.489540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12101c27-7488-4f8f-98ae-aa527ae19d9e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.522577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.523408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.523692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.523988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.531120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.532568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:10:21.547030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:21.548101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:21.549212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 526/1077] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:21.553952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.565348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab262491-d0ab-46a4-929c-16ef7a1e732f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.595593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:21.599275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.600058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.600339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.600609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.611002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:21.619065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:21.620098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:21.620938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 552/1078] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:21.626285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.653388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995e79f-53d8-4e5d-afb9-8b6d749b6d59 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.674254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:21.687416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.688076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.688362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.688639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.689450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:21.689764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.691265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.702989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 527/1079] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:21.708751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.725004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0061-6830-4562-9f52-f18bd0c752cb None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.758493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.759143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.759372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.759646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.760375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:21.760727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.762091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.770159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 553/1080] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:21.776609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:21.806275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdbcce4-02ca-4628-9eff-be9486bf4ab2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.807830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:21.841737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.842619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.842929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.843208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/a8c2616d20ea41f7ad4f953138f5636e/roles/3b4d675542b74833ab10f0f3cc67f246` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.845456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=a8c2616d20ea41f7ad4f953138f5636e, role_id=3b4d675542b74833ab10f0f3cc67f246)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.846920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.861058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 528/1081] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:10:21 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/a8c2616d20ea41f7ad4f953138f5636e/roles/3b4d675542b74833ab10f0f3cc67f246 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:10:21.876383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b49da-1d78-4e88-a60e-6bb26cdf44c2 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:21.890815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:21.913753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:21.915310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:21.915598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:21.915875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] PATH_INFO: `/v3/users/31bf42035c454579947923b954f90631` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:21.917207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] RBAC: Authorizing `identity:get_user(user_id=31bf42035c454579947923b954f90631)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:21.918703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:21.920428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 554/1082] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/users/31bf42035c454579947923b954f90631 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:21.926674 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:22.031091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cda5a8-412a-4439-b430-8254ea834c12 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:22.064277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4525e5-812b-4308-b9dc-d564cd59c46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:22.065128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4525e5-812b-4308-b9dc-d564cd59c46b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:22.065408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4525e5-812b-4308-b9dc-d564cd59c46b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:22.065680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4525e5-812b-4308-b9dc-d564cd59c46b None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:22.066878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4525e5-812b-4308-b9dc-d564cd59c46b None admin] RBAC: Authorizing `identity:get_project(project_id=e2953c13dad84373a16c4af2bcdca36d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:22.068319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4525e5-812b-4308-b9dc-d564cd59c46b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:22.069999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 529/1083] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:21 2022] GET /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:22.076333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:22.186103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ee3ab-951a-4095-84c1-6ea770b480b8 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:22.222565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29f18-c9d6-4913-adc0-84dcf4d7c18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:22.223476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29f18-c9d6-4913-adc0-84dcf4d7c18a None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:22.223756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29f18-c9d6-4913-adc0-84dcf4d7c18a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:22.224082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29f18-c9d6-4913-adc0-84dcf4d7c18a None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d/users/31bf42035c454579947923b954f90631/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:22.226042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29f18-c9d6-4913-adc0-84dcf4d7c18a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2953c13dad84373a16c4af2bcdca36d, user_id=31bf42035c454579947923b954f90631, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:22.227524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29f18-c9d6-4913-adc0-84dcf4d7c18a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:22.239912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 555/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:10:22 2022] PUT /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d/users/31bf42035c454579947923b954f90631/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:10:23.860475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84d62-d49b-4239-8aa9-eb0a8380a0fa None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:23.860982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84d62-d49b-4239-8aa9-eb0a8380a0fa None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:23.860982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84d62-d49b-4239-8aa9-eb0a8380a0fa None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:23.862438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 530/1085] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:23.867298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86a1b0-2661-458b-9cc7-e53bf41cf755 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:23.867744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86a1b0-2661-458b-9cc7-e53bf41cf755 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:23.867952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86a1b0-2661-458b-9cc7-e53bf41cf755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:23.885531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2c86a1b0-2661-458b-9cc7-e53bf41cf755 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:23.886749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2c86a1b0-2661-458b-9cc7-e53bf41cf755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:23.920261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:23.954216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 556/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:23.977982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f84d62-d49b-4239-8aa9-eb0a8380a0fa None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.008930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.080552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f84d62-d49b-4239-8aa9-eb0a8380a0fa None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.113059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce33db-3d85-4987-a98d-f444c4cc97cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.113792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce33db-3d85-4987-a98d-f444c4cc97cb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.114075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce33db-3d85-4987-a98d-f444c4cc97cb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.114350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce33db-3d85-4987-a98d-f444c4cc97cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.125375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce33db-3d85-4987-a98d-f444c4cc97cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7cce33db-3d85-4987-a98d-f444c4cc97cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:24.133966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:24.135100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:24.135968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 531/1087] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 30 10:10:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:24.141068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86a1b0-2661-458b-9cc7-e53bf41cf755 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.236686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86a1b0-2661-458b-9cc7-e53bf41cf755 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.247356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681889-20f1-4b5b-b1a8-8a0bb36c0f92 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.247646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681889-20f1-4b5b-b1a8-8a0bb36c0f92 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.247920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f681889-20f1-4b5b-b1a8-8a0bb36c0f92 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.249277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 532/1088] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:24.254034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605a4f-7ae9-43f9-9d8b-cf5cfbc377bf None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.254316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605a4f-7ae9-43f9-9d8b-cf5cfbc377bf None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.254589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605a4f-7ae9-43f9-9d8b-cf5cfbc377bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.271280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.271948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.272232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.272333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-63605a4f-7ae9-43f9-9d8b-cf5cfbc377bf None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:24.272512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.273258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:24.273496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-63605a4f-7ae9-43f9-9d8b-cf5cfbc377bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:24.273598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:24.275045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:24.283991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 557/1089] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:24.289627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.320358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.343039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 533/1090] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:10:24.366952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605a4f-7ae9-43f9-9d8b-cf5cfbc377bf None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.387167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.390279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9895a-f624-4394-bfff-eddff14d1f0e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.423101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.423903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.424183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.424460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.435142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:24.436576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:24.453058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:24.454115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:24.459846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:24.459846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:24.459846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:24.459846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:24.459846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 558/1091] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:24.460198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.465395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605a4f-7ae9-43f9-9d8b-cf5cfbc377bf None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.502581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.503395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.503679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.503956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.514436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:24.522170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:24.523157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:24.524017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 534/1092] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:24.529227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.544182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.560981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ee1ef-b631-4125-8c7c-c62f5f9b4693 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.595758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.596416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.596704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.596984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.597705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:24.598015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:24.599421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:24.610235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.611231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 559/1093] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:24.616594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.629509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a825ab-4cfd-439a-83dd-e591f42a4ed0 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.662991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.663647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.663930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.664204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.664991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:24.665295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:24.666669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:24.674768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 535/1094] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:24.680540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.718150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43963-745a-4d4b-8b5f-fa0d63e29805 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.751385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.752155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.752435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.752710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.760095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:24.761516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:10:24.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:24.777182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:24.778244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 560/1095] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:24.778904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec977-e345-4dc5-99cf-551b32d823ef None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.782952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.786267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.812745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.813604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.813893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.814168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] PATH_INFO: `/v3/users/31bf42035c454579947923b954f90631` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.815384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] RBAC: Authorizing `identity:get_user(user_id=31bf42035c454579947923b954f90631)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:24.816830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:24.818465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 536/1096] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/users/31bf42035c454579947923b954f90631 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:24.824831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.837003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:24.881792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8db8-68f6-4853-adff-e5b5cfa2125a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.916044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.916703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.916988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.917266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:24.918102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:24.918412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:24.919871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:24.924795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665dddc-8597-40ec-992d-b96e6dc0ea0e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:24.936912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 561/1097] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:24.942492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:24.959656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:24.960303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:24.960621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:24.960895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.002815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:25.028140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.029610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.041054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:25.042344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188138-909e-4029-bb4d-c58fd3d5d6bb None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:25.075796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:25.077422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:25.077709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:25.077986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.128213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 537/1098] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:10:25.134763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:25.144982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.146423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.205357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:25.232352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ef0f-a382-43eb-9aa5-3cf4bdff5abc None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:25.242897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:25.244894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 562/1099] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 10:10:25.250465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:25.266823 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:25.267675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:25.267957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:25.268229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.269391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] RBAC: Authorizing `identity:get_project(project_id=e2953c13dad84373a16c4af2bcdca36d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.270868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.272537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 538/1100] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:25 2022] GET /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:25.279043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:25.353380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d2bb4-9a2d-476c-a280-56a23fa5ea27 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:25.380771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badcc5d-27e2-412e-a3d4-983c83c3fda6 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:25.386376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:25.387118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:25.387397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:25.387663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.397429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.399494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.415800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:25.416456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:25.416740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:25.417017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.417843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=e2953c13dad84373a16c4af2bcdca36d, user.id=31bf42035c454579947923b954f90631) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:25.418156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:25.419240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:25.420265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:25.421340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:10:25.421340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:25.421340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:10:25.421340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:25.421594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.422832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 563/1101] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:10:25.425684 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 539/1102] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:25 2022] GET /identity/v3/role_assignments?user.id=31bf42035c454579947923b954f90631&scope.project.id=e2953c13dad84373a16c4af2bcdca36d&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:25.426007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:25.442118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:25.540261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98fad-04bd-4224-9a56-3767ef424d89 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:25.578604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:25.579303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:25.579592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:25.579867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.580589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:25.580895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.582257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.594009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 564/1103] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:25.600243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:25.644401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:25.699707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040c59b-aeb9-4c7f-8801-734238d10ea2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:25.732369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:25.733154 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:25.733435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:25.733709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.740261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.741703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:10:25.755661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:25.756599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:25.757676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 540/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:25.763195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:25.837098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:25.862115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfb62e-3dae-47e3-ab5f-b283471ae748 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:25.894834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f13a01-9003-4edc-a614-00f7217d25bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:25.895417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13a01-9003-4edc-a614-00f7217d25bd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:25.895687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13a01-9003-4edc-a614-00f7217d25bd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:25.895959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f13a01-9003-4edc-a614-00f7217d25bd None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:25.896736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13a01-9003-4edc-a614-00f7217d25bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:25.897042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13a01-9003-4edc-a614-00f7217d25bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:25.898455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f13a01-9003-4edc-a614-00f7217d25bd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:25.910887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 565/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:25.917073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:26.014386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053103b-6ed9-4ec6-a495-35a35e5939b9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:26.015946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:26.047540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b2b88-83df-45c3-8b4d-11e5bb4fb27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:26.048182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2b88-83df-45c3-8b4d-11e5bb4fb27c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:26.048463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2b88-83df-45c3-8b4d-11e5bb4fb27c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:26.048736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2b88-83df-45c3-8b4d-11e5bb4fb27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:26.049564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b2b88-83df-45c3-8b4d-11e5bb4fb27c None admin] RBAC: Adding query filter params (role.id=3b4d675542b74833ab10f0f3cc67f246, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=a8c2616d20ea41f7ad4f953138f5636e) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:26.049876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b2b88-83df-45c3-8b4d-11e5bb4fb27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:26.051345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b2b88-83df-45c3-8b4d-11e5bb4fb27c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:26.057072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 541/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:25 2022] GET /identity/v3/role_assignments?user.id=a8c2616d20ea41f7ad4f953138f5636e&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=3b4d675542b74833ab10f0f3cc67f246 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:27.488235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127940-50e6-4e86-8825-ee5992ade5b1 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:27.488751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127940-50e6-4e86-8825-ee5992ade5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:27.488943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127940-50e6-4e86-8825-ee5992ade5b1 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:27.490180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 566/1107] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:27.496129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284637-afdd-4a01-9af4-64c8882c1ccc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:27.496527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284637-afdd-4a01-9af4-64c8882c1ccc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:27.496708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284637-afdd-4a01-9af4-64c8882c1ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:27.513713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-43284637-afdd-4a01-9af4-64c8882c1ccc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:27.514937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-43284637-afdd-4a01-9af4-64c8882c1ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:27.578938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 542/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:27.605473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79127940-50e6-4e86-8825-ee5992ade5b1 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:27.703072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79127940-50e6-4e86-8825-ee5992ade5b1 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:27.735834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5b7ac-ad9a-4964-a108-6be2015c07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:27.736595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b7ac-ad9a-4964-a108-6be2015c07ee None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:27.736874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b7ac-ad9a-4964-a108-6be2015c07ee None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:27.737147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b7ac-ad9a-4964-a108-6be2015c07ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:27.738346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5b7ac-ad9a-4964-a108-6be2015c07ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:27.739747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5b7ac-ad9a-4964-a108-6be2015c07ee None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:27.741330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 567/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:27.747427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284637-afdd-4a01-9af4-64c8882c1ccc None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:27.837486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:27.843859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284637-afdd-4a01-9af4-64c8882c1ccc None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:27.877403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ec18e-4a80-4210-9e12-5f126d7bf81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:27.878055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ec18e-4a80-4210-9e12-5f126d7bf81a None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:27.878336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ec18e-4a80-4210-9e12-5f126d7bf81a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:27.878610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ec18e-4a80-4210-9e12-5f126d7bf81a None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:27.879351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ec18e-4a80-4210-9e12-5f126d7bf81a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:27.880784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ec18e-4a80-4210-9e12-5f126d7bf81a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:27.900661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 543/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:10:27 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:10:29.956276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ea00-8c29-45dd-adf2-08547e191ef3 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:29.956805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ea00-8c29-45dd-adf2-08547e191ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:29.956805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157ea00-8c29-45dd-adf2-08547e191ef3 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:29.958182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 568/1111] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:29.964282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1c6da-da8d-49a4-a6a3-c9b57634d92f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:29.964708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1c6da-da8d-49a4-a6a3-c9b57634d92f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:29.964835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1c6da-da8d-49a4-a6a3-c9b57634d92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:29.981660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-88e1c6da-da8d-49a4-a6a3-c9b57634d92f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:29.982861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-88e1c6da-da8d-49a4-a6a3-c9b57634d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:30.046871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 544/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:30.069839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ea00-8c29-45dd-adf2-08547e191ef3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:30.073008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:30.174146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157ea00-8c29-45dd-adf2-08547e191ef3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:30.206014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:30.206942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:30.207167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:30.207439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] PATH_INFO: `/v3/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:30.208883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] RBAC: Authorizing `identity:get_role(role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:30.210232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:30.212140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 569/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:30 2022] GET /identity/v3/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:30.217908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1c6da-da8d-49a4-a6a3-c9b57634d92f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:30.295508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:30.313431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1c6da-da8d-49a4-a6a3-c9b57634d92f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:30.346218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:30.347206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:30.347489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:30.347762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] PATH_INFO: `/v3/users/a59243d081444d98b62f5a93b7fc151f` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:30.360909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] RBAC: Authorizing `identity:get_user(user_id=a59243d081444d98b62f5a93b7fc151f)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:30.362352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:30.364001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 545/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:30 2022] GET /identity/v3/users/a59243d081444d98b62f5a93b7fc151f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:30.369672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:30.437152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:30.469901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55c980-16de-4048-9549-a88d77573357 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:30.502371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:30.503045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:30.503334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:30.503611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:30.574440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:30.575912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:30.640963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:30.671903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 570/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:10:30.677764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:30.774373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b66640-8cf6-414f-8a46-74f81a1fda7c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:30.807019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29461b-b8f6-433f-ac97-95bf8a3b33e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:30.807848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29461b-b8f6-433f-ac97-95bf8a3b33e5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:30.808129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29461b-b8f6-433f-ac97-95bf8a3b33e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:30.808402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29461b-b8f6-433f-ac97-95bf8a3b33e5 None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:30.809554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29461b-b8f6-433f-ac97-95bf8a3b33e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e2953c13dad84373a16c4af2bcdca36d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:30.811002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29461b-b8f6-433f-ac97-95bf8a3b33e5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:30.812636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 546/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:30 2022] GET /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:30.818395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:30.913617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e222-c2f5-409a-b532-f8e10ddc7578 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:30.946831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f57dc2-3cd4-4263-a852-eb4cd0ba70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:30.947464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57dc2-3cd4-4263-a852-eb4cd0ba70fd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:30.947746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57dc2-3cd4-4263-a852-eb4cd0ba70fd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:30.948022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57dc2-3cd4-4263-a852-eb4cd0ba70fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:30.948839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f57dc2-3cd4-4263-a852-eb4cd0ba70fd None admin] RBAC: Adding query filter params (role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=e2953c13dad84373a16c4af2bcdca36d, user.id=a59243d081444d98b62f5a93b7fc151f) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:30.949151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f57dc2-3cd4-4263-a852-eb4cd0ba70fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:30.950549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f57dc2-3cd4-4263-a852-eb4cd0ba70fd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:30.955838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 571/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:30 2022] GET /identity/v3/role_assignments?user.id=a59243d081444d98b62f5a93b7fc151f&scope.project.id=e2953c13dad84373a16c4af2bcdca36d&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:32.911994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e642c5-55cc-44d9-8e4f-c21e41163d63 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:32.912524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e642c5-55cc-44d9-8e4f-c21e41163d63 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:32.912524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e642c5-55cc-44d9-8e4f-c21e41163d63 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:32.913881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 547/1118] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:32.919532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef158d-3961-40ca-b9bc-9b5dfa1ee403 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:32.919972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef158d-3961-40ca-b9bc-9b5dfa1ee403 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:32.920081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef158d-3961-40ca-b9bc-9b5dfa1ee403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:32.936776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-12ef158d-3961-40ca-b9bc-9b5dfa1ee403 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:32.937942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-12ef158d-3961-40ca-b9bc-9b5dfa1ee403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:32.963724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:33.002809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 572/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:33.025021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e642c5-55cc-44d9-8e4f-c21e41163d63 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:33.035593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:33.124486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e642c5-55cc-44d9-8e4f-c21e41163d63 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:33.161973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:33.162900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:33.163131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:33.163405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] PATH_INFO: `/v3/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:33.165530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] RBAC: Authorizing `identity:get_role(role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:33.166936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:33.168298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 548/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:33 2022] GET /identity/v3/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:33.174370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef158d-3961-40ca-b9bc-9b5dfa1ee403 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:33.269158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef158d-3961-40ca-b9bc-9b5dfa1ee403 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:33.302450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:33.303321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:33.303603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:33.303877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] PATH_INFO: `/v3/users/a59243d081444d98b62f5a93b7fc151f` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:33.305074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] RBAC: Authorizing `identity:get_user(user_id=a59243d081444d98b62f5a93b7fc151f)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:33.306498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:33.308130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 573/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:33 2022] GET /identity/v3/users/a59243d081444d98b62f5a93b7fc151f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:33.313818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:33.388780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:33.411649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a4828-d309-4f21-bb1a-338e12872b86 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:33.447945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e746d8-0630-45cc-931c-3c69e4cd8568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:33.448720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e746d8-0630-45cc-931c-3c69e4cd8568 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:33.449007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e746d8-0630-45cc-931c-3c69e4cd8568 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:33.449289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e746d8-0630-45cc-931c-3c69e4cd8568 None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:33.450473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e746d8-0630-45cc-931c-3c69e4cd8568 None admin] RBAC: Authorizing `identity:get_project(project_id=e2953c13dad84373a16c4af2bcdca36d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:33.451957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e746d8-0630-45cc-931c-3c69e4cd8568 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:33.453641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 549/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:33 2022] GET /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:33.459774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:33.490115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:33.556161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950b25c-8df7-4e4e-9d33-3d309bed8b2f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:33.588987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9427d45-e0eb-43ab-944d-ae17bf3b546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:33.589852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9427d45-e0eb-43ab-944d-ae17bf3b546b None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:33.590130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9427d45-e0eb-43ab-944d-ae17bf3b546b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:33.590399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9427d45-e0eb-43ab-944d-ae17bf3b546b None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d/users/a59243d081444d98b62f5a93b7fc151f/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:33.592585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9427d45-e0eb-43ab-944d-ae17bf3b546b None admin] RBAC: Authorizing `identity:create_grant(project_id=e2953c13dad84373a16c4af2bcdca36d, user_id=a59243d081444d98b62f5a93b7fc151f, role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:33.593985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9427d45-e0eb-43ab-944d-ae17bf3b546b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:33.606055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 574/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:10:33 2022] PUT /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d/users/a59243d081444d98b62f5a93b7fc151f/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:10:35.597094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453e0b-c79f-43f2-a8b1-c2ca111ec5b2 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:35.597633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453e0b-c79f-43f2-a8b1-c2ca111ec5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:35.597633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9453e0b-c79f-43f2-a8b1-c2ca111ec5b2 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:35.599035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 550/1124] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:35.604952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbf839-0641-4808-bc21-b41393c2837b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:35.605376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbf839-0641-4808-bc21-b41393c2837b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:35.605515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbf839-0641-4808-bc21-b41393c2837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:35.622036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5afbf839-0641-4808-bc21-b41393c2837b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:35.623249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5afbf839-0641-4808-bc21-b41393c2837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:35.687490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 575/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:35.715839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453e0b-c79f-43f2-a8b1-c2ca111ec5b2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:35.814260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9453e0b-c79f-43f2-a8b1-c2ca111ec5b2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:35.847494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:35.848330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:35.848609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:35.848882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] PATH_INFO: `/v3/roles/548c2820a3574d95969883b5c5ecf4c8` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:35.850334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] RBAC: Authorizing `identity:get_role(role_id=548c2820a3574d95969883b5c5ecf4c8)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:35.851751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:35.853077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 551/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:35 2022] GET /identity/v3/roles/548c2820a3574d95969883b5c5ecf4c8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:35.858899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbf839-0641-4808-bc21-b41393c2837b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:35.881553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:35.955042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbf839-0641-4808-bc21-b41393c2837b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:35.987239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:35.988085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:35.988363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:35.988637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] PATH_INFO: `/v3/users/a59243d081444d98b62f5a93b7fc151f` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:35.989798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] RBAC: Authorizing `identity:get_user(user_id=a59243d081444d98b62f5a93b7fc151f)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:35.991246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:35.993369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 576/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:35 2022] GET /identity/v3/users/a59243d081444d98b62f5a93b7fc151f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:35.998958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:36.013884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:36.094944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77e8e3-e559-4bcb-98a0-8985c33976bb None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:36.127399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:36.128030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:36.128308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:36.128580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:36.192172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:36.193700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:36.207224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:36.288259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 552/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:10:36.293936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:36.380924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:36.390674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a3b2-ca78-42a8-814b-e1b0fb78cc58 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:36.423127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fcfda-f602-405d-a162-a34b6e40e2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:36.423958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fcfda-f602-405d-a162-a34b6e40e2fd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:36.424244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fcfda-f602-405d-a162-a34b6e40e2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:36.424523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fcfda-f602-405d-a162-a34b6e40e2fd None admin] PATH_INFO: `/v3/projects/e2953c13dad84373a16c4af2bcdca36d` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:36.425694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fcfda-f602-405d-a162-a34b6e40e2fd None admin] RBAC: Authorizing `identity:get_project(project_id=e2953c13dad84373a16c4af2bcdca36d)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:36.427147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fcfda-f602-405d-a162-a34b6e40e2fd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:36.428804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 577/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:36 2022] GET /identity/v3/projects/e2953c13dad84373a16c4af2bcdca36d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:36.435171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:36.530936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e981584-fdc9-423f-b707-a81a7f261992 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:36.543868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:36.565033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb942bf-1c7a-44c4-b597-d3411d556215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:36.565675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb942bf-1c7a-44c4-b597-d3411d556215 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:36.565955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb942bf-1c7a-44c4-b597-d3411d556215 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:36.566228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb942bf-1c7a-44c4-b597-d3411d556215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:36.567078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb942bf-1c7a-44c4-b597-d3411d556215 None admin] RBAC: Adding query filter params (role.id=548c2820a3574d95969883b5c5ecf4c8, scope.project.id=e2953c13dad84373a16c4af2bcdca36d, user.id=a59243d081444d98b62f5a93b7fc151f) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:36.567385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb942bf-1c7a-44c4-b597-d3411d556215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:36.568812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb942bf-1c7a-44c4-b597-d3411d556215 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:36.574735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 553/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:36 2022] GET /identity/v3/role_assignments?user.id=a59243d081444d98b62f5a93b7fc151f&scope.project.id=e2953c13dad84373a16c4af2bcdca36d&role.id=548c2820a3574d95969883b5c5ecf4c8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:38.595979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd6f6-89dd-4ee7-b09c-4cfd223c083d None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:38.596511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd6f6-89dd-4ee7-b09c-4cfd223c083d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:38.596511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd6f6-89dd-4ee7-b09c-4cfd223c083d None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:38.597884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 578/1131] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:38.603716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763efb-181d-4866-aed3-b2cb40549999 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:38.604148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763efb-181d-4866-aed3-b2cb40549999 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:38.604278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763efb-181d-4866-aed3-b2cb40549999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:38.620609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-e1763efb-181d-4866-aed3-b2cb40549999 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:38.621797 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e1763efb-181d-4866-aed3-b2cb40549999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:38.686660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 554/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:38.710226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dd6f6-89dd-4ee7-b09c-4cfd223c083d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:38.806676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dd6f6-89dd-4ee7-b09c-4cfd223c083d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:38.839537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc771f9e-5eda-47df-b9b0-eee3ec6ec0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:38.840298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc771f9e-5eda-47df-b9b0-eee3ec6ec0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:38.840576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc771f9e-5eda-47df-b9b0-eee3ec6ec0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:38.840847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc771f9e-5eda-47df-b9b0-eee3ec6ec0f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:38.842030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc771f9e-5eda-47df-b9b0-eee3ec6ec0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:38.843468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc771f9e-5eda-47df-b9b0-eee3ec6ec0f8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:38.845057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 579/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:38.850631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763efb-181d-4866-aed3-b2cb40549999 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:38.946662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763efb-181d-4866-aed3-b2cb40549999 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:38.954486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:38.980703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab13d39-ffe3-4d94-b6c6-d195386606ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:38.981346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab13d39-ffe3-4d94-b6c6-d195386606ad None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:38.981624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab13d39-ffe3-4d94-b6c6-d195386606ad None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:38.981896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab13d39-ffe3-4d94-b6c6-d195386606ad None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:38.982595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab13d39-ffe3-4d94-b6c6-d195386606ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:38.984039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab13d39-ffe3-4d94-b6c6-d195386606ad None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:39.008679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 555/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:10:38 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:10:41.060521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b21023-26bb-4a0d-81f4-52bbe71e0acb None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:41.061048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b21023-26bb-4a0d-81f4-52bbe71e0acb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:41.061048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b21023-26bb-4a0d-81f4-52bbe71e0acb None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:41.062430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 580/1135] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:41.067537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9213b-31f7-4380-b4e8-0c665c8dee16 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:41.067969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9213b-31f7-4380-b4e8-0c665c8dee16 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:41.068099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9213b-31f7-4380-b4e8-0c665c8dee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:41.085225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-59f9213b-31f7-4380-b4e8-0c665c8dee16 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:41.087033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-59f9213b-31f7-4380-b4e8-0c665c8dee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:41.151203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 556/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:41.175172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b21023-26bb-4a0d-81f4-52bbe71e0acb None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:41.204580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:41.275615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b21023-26bb-4a0d-81f4-52bbe71e0acb None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:41.307821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd43ba2-5a5f-4331-86ee-a70818afd4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:41.308581 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd43ba2-5a5f-4331-86ee-a70818afd4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:41.308860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd43ba2-5a5f-4331-86ee-a70818afd4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:41.309133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd43ba2-5a5f-4331-86ee-a70818afd4a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:41.310284 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd43ba2-5a5f-4331-86ee-a70818afd4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:41.311789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd43ba2-5a5f-4331-86ee-a70818afd4a9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:41.313329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 581/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:41.319018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9213b-31f7-4380-b4e8-0c665c8dee16 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:41.403875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:41.416461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9213b-31f7-4380-b4e8-0c665c8dee16 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:41.449806 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cddf6-9dcd-4874-add5-369121dbc52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:41.450461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cddf6-9dcd-4874-add5-369121dbc52a None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:41.450772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cddf6-9dcd-4874-add5-369121dbc52a None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:41.451048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cddf6-9dcd-4874-add5-369121dbc52a None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:41.451756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cddf6-9dcd-4874-add5-369121dbc52a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:41.453183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cddf6-9dcd-4874-add5-369121dbc52a None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:41.472201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 557/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:10:41 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:10:43.505983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0acce6-aea3-4777-946f-83e84986382a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:43.506510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0acce6-aea3-4777-946f-83e84986382a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:43.506510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0acce6-aea3-4777-946f-83e84986382a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:43.508539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 582/1139] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:43.513675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaf849-ba1d-42a0-ad1a-f0efa68dc99b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:43.514065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaf849-ba1d-42a0-ad1a-f0efa68dc99b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:43.514224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaf849-ba1d-42a0-ad1a-f0efa68dc99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:43.531762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-abdaf849-ba1d-42a0-ad1a-f0efa68dc99b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:43.533293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-abdaf849-ba1d-42a0-ad1a-f0efa68dc99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:43.603931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 558/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:43.628001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0acce6-aea3-4777-946f-83e84986382a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:43.717679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:43.725129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0acce6-aea3-4777-946f-83e84986382a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:43.758174 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:43.758907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:43.759190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:43.759463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:43.769129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:43.776713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:43.777875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:43.779016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 583/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:43.783847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaf849-ba1d-42a0-ad1a-f0efa68dc99b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:43.862126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:43.887632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaf849-ba1d-42a0-ad1a-f0efa68dc99b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:43.920947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:43.921602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:43.921883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:43.922158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:43.922933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:43.923242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:43.924622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:43.933006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 559/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:10:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:43.938703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:44.033605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5873bd7-35ba-427f-a56b-0727ba171081 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:44.067131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:44.067975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:44.068258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:44.068532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] PATH_INFO: `/v3/users/593ab4bcf8bb4f69b7762c2e297862b1` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:44.082027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] RBAC: Authorizing `identity:get_user(user_id=593ab4bcf8bb4f69b7762c2e297862b1)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:44.083482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:44.085110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 584/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:43 2022] GET /identity/v3/users/593ab4bcf8bb4f69b7762c2e297862b1 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:44.090750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:44.188331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4e523-8a09-4411-a6cd-192ec8447b59 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:44.224646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:44.225284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:44.225643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:44.225919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:44.229859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:44.290966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:44.292344 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:44.387080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 560/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:10:44.392889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:44.408030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:44.492754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976c56f-7138-435b-a910-9eb4a24b4f3a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:44.525437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b7c2a-c50d-4863-962d-f4b14b1afcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:44.526266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b7c2a-c50d-4863-962d-f4b14b1afcdc None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:44.526544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b7c2a-c50d-4863-962d-f4b14b1afcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:44.526845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b7c2a-c50d-4863-962d-f4b14b1afcdc None admin] PATH_INFO: `/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:44.527994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b7c2a-c50d-4863-962d-f4b14b1afcdc None admin] RBAC: Authorizing `identity:get_project(project_id=8b06a9b1b6424e9e99a1a77dc3f0c9b6)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:44.529439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b7c2a-c50d-4863-962d-f4b14b1afcdc None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:44.531141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 585/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:44 2022] GET /identity/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:44.537304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:44.576158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:44.640086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec49203-771d-45da-a0f5-d2cd1aaa79bf None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:44.672513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10128-a18f-4372-99df-1bfbf729de7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:44.673155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10128-a18f-4372-99df-1bfbf729de7f None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:44.673434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10128-a18f-4372-99df-1bfbf729de7f None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:44.673704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10128-a18f-4372-99df-1bfbf729de7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:44.674519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10128-a18f-4372-99df-1bfbf729de7f None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=8b06a9b1b6424e9e99a1a77dc3f0c9b6, user.id=593ab4bcf8bb4f69b7762c2e297862b1) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:44.674857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10128-a18f-4372-99df-1bfbf729de7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:44.676281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10128-a18f-4372-99df-1bfbf729de7f None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:44.681503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 561/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:44 2022] GET /identity/v3/role_assignments?user.id=593ab4bcf8bb4f69b7762c2e297862b1&scope.project.id=8b06a9b1b6424e9e99a1a77dc3f0c9b6&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:46.679937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944982-077b-43aa-890f-edeb56d8cf8c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:46.680464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944982-077b-43aa-890f-edeb56d8cf8c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:46.680562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944982-077b-43aa-890f-edeb56d8cf8c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:46.681864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 586/1147] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:46.687311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005594a2-0871-46ba-8942-7976326714bf None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:46.687743 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005594a2-0871-46ba-8942-7976326714bf None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:46.687842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005594a2-0871-46ba-8942-7976326714bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:46.704311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-005594a2-0871-46ba-8942-7976326714bf None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:46.705473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-005594a2-0871-46ba-8942-7976326714bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:46.769537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 562/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:46.792552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4944982-077b-43aa-890f-edeb56d8cf8c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:46.870908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:46.890968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4944982-077b-43aa-890f-edeb56d8cf8c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:46.924500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:46.925278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:46.925564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:46.925843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:46.935728 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:46.943314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:46.944387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:46.945757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 587/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:46.951633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005594a2-0871-46ba-8942-7976326714bf None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:46.980270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:47.046139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005594a2-0871-46ba-8942-7976326714bf None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:47.078719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:47.079371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:47.079652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:47.079923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:47.080650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:47.080952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:47.082318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:47.090565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 563/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:47.096248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:47.192097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf62b-02e1-43bb-a760-10568c015011 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:47.225326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:47.226224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:47.226615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:47.226947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] PATH_INFO: `/v3/users/593ab4bcf8bb4f69b7762c2e297862b1` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:47.228234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] RBAC: Authorizing `identity:get_user(user_id=593ab4bcf8bb4f69b7762c2e297862b1)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:47.229671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:47.231345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 588/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:47 2022] GET /identity/v3/users/593ab4bcf8bb4f69b7762c2e297862b1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:10:47.237226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:47.326098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:47.335147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa4f11-411c-497c-9cea-73f4c2b57cd9 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:47.367110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e48c5-8f7a-47b7-91d0-bdaac8255129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:47.367948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e48c5-8f7a-47b7-91d0-bdaac8255129 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:47.368225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e48c5-8f7a-47b7-91d0-bdaac8255129 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:47.368495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e48c5-8f7a-47b7-91d0-bdaac8255129 None admin] PATH_INFO: `/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:47.369649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e48c5-8f7a-47b7-91d0-bdaac8255129 None admin] RBAC: Authorizing `identity:get_project(project_id=8b06a9b1b6424e9e99a1a77dc3f0c9b6)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:47.371117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e48c5-8f7a-47b7-91d0-bdaac8255129 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:47.372766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 564/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:47 2022] GET /identity/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:47.378531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:47.389983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:47.476081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d313-6722-4d25-9e18-54e0cbf69714 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:47.509210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812c1d8-dd41-4e65-97c1-7e75c04b44b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:47.510094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c1d8-dd41-4e65-97c1-7e75c04b44b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:47.510376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c1d8-dd41-4e65-97c1-7e75c04b44b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:47.510654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812c1d8-dd41-4e65-97c1-7e75c04b44b1 None admin] PATH_INFO: `/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6/users/593ab4bcf8bb4f69b7762c2e297862b1/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:47.512658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c1d8-dd41-4e65-97c1-7e75c04b44b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b06a9b1b6424e9e99a1a77dc3f0c9b6, user_id=593ab4bcf8bb4f69b7762c2e297862b1, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:47.514214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812c1d8-dd41-4e65-97c1-7e75c04b44b1 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:47.527195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 589/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:10:47 2022] PUT /identity/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6/users/593ab4bcf8bb4f69b7762c2e297862b1/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:10:49.554291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852acc0-298e-4128-9370-ecde60678fe7 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:49.554833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852acc0-298e-4128-9370-ecde60678fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:49.554946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852acc0-298e-4128-9370-ecde60678fe7 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:49.556250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 565/1154] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:49.561462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3863ea-e6bb-4604-b7f6-20cee2d6a4ff None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:49.561888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3863ea-e6bb-4604-b7f6-20cee2d6a4ff None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:49.562030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3863ea-e6bb-4604-b7f6-20cee2d6a4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:49.579422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ac3863ea-e6bb-4604-b7f6-20cee2d6a4ff None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:49.580608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ac3863ea-e6bb-4604-b7f6-20cee2d6a4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:49.650225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:49.657205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 590/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:49.682099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852acc0-298e-4128-9370-ecde60678fe7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:49.803350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852acc0-298e-4128-9370-ecde60678fe7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:49.837295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:49.838068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:49.838348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:49.838620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:49.850156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:10:49.858282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:49.859532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:10:49.860610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 566/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:49.865735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3863ea-e6bb-4604-b7f6-20cee2d6a4ff None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:49.971814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3863ea-e6bb-4604-b7f6-20cee2d6a4ff None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:50.008144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:50.009112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:50.009596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:50.010088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:50.010974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:50.011290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:50.012730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:50.020706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 591/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:50.027023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:50.047970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:50.122418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c96907-9411-403f-8264-59e0650a8034 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:50.155188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:50.156033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:50.156312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:50.156583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] PATH_INFO: `/v3/users/593ab4bcf8bb4f69b7762c2e297862b1` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:50.157738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] RBAC: Authorizing `identity:get_user(user_id=593ab4bcf8bb4f69b7762c2e297862b1)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:50.159203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:50.160774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 567/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:10:50 2022] GET /identity/v3/users/593ab4bcf8bb4f69b7762c2e297862b1 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:50.166377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:50.223910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:50.264111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c499b8-97cb-44b2-b1fe-7e588875c840 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:50.295985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:50.296614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:50.296894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:50.297166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:50.361319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:50.362765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:50.416667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:50.456972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 592/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:10:50.462816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:50.547969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:50.560636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65cdfb-ddfe-4255-b982-5195c557eea2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:50.594410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a49f7-66a4-4df6-948b-c5aed2f512a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:50.595280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a49f7-66a4-4df6-948b-c5aed2f512a4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:50.595566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a49f7-66a4-4df6-948b-c5aed2f512a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:50.595839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a49f7-66a4-4df6-948b-c5aed2f512a4 None admin] PATH_INFO: `/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:50.597013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a49f7-66a4-4df6-948b-c5aed2f512a4 None admin] RBAC: Authorizing `identity:get_project(project_id=8b06a9b1b6424e9e99a1a77dc3f0c9b6)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:50.598479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a49f7-66a4-4df6-948b-c5aed2f512a4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:50.600191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 568/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:10:50 2022] GET /identity/v3/projects/8b06a9b1b6424e9e99a1a77dc3f0c9b6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:50.606735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:50.702771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047f55a-fc48-4512-8d45-91639f581af8 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:50.735929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d35f-fbfc-443d-94a9-772815c7facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:50.736566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d35f-fbfc-443d-94a9-772815c7facd None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:50.736853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d35f-fbfc-443d-94a9-772815c7facd None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:50.737132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d35f-fbfc-443d-94a9-772815c7facd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:50.737961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d35f-fbfc-443d-94a9-772815c7facd None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=8b06a9b1b6424e9e99a1a77dc3f0c9b6, user.id=593ab4bcf8bb4f69b7762c2e297862b1) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:50.738277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d35f-fbfc-443d-94a9-772815c7facd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:50.739727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d35f-fbfc-443d-94a9-772815c7facd None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:50.746043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 593/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:10:50 2022] GET /identity/v3/role_assignments?user.id=593ab4bcf8bb4f69b7762c2e297862b1&scope.project.id=8b06a9b1b6424e9e99a1a77dc3f0c9b6&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:52.754666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c9d3-35a0-4b45-9433-6ee5732ca0cb None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:52.755266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c9d3-35a0-4b45-9433-6ee5732ca0cb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:52.755266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c9d3-35a0-4b45-9433-6ee5732ca0cb None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:52.756517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 569/1162] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:52.761537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de4eb-753e-4154-ac2e-e97463f1144a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:52.761976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de4eb-753e-4154-ac2e-e97463f1144a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:52.762093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398de4eb-753e-4154-ac2e-e97463f1144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:52.778871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-398de4eb-753e-4154-ac2e-e97463f1144a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:52.780042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-398de4eb-753e-4154-ac2e-e97463f1144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:52.797166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:52.844606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 594/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:52.867193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c9d3-35a0-4b45-9433-6ee5732ca0cb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:52.973121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c9d3-35a0-4b45-9433-6ee5732ca0cb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:53.005145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b090b-d943-4121-a32a-3526b799590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:53.005715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b090b-d943-4121-a32a-3526b799590b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:53.005996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b090b-d943-4121-a32a-3526b799590b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:53.006270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b090b-d943-4121-a32a-3526b799590b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:53.030536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:53.072614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b090b-d943-4121-a32a-3526b799590b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:53.074065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b090b-d943-4121-a32a-3526b799590b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:53.168362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 570/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:10:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:10:53.174228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de4eb-753e-4154-ac2e-e97463f1144a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:53.268972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398de4eb-753e-4154-ac2e-e97463f1144a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:53.307839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b5201-8422-49aa-bc66-64759f52fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:53.308618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b5201-8422-49aa-bc66-64759f52fa32 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:53.308896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b5201-8422-49aa-bc66-64759f52fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:53.309167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b5201-8422-49aa-bc66-64759f52fa32 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:53.315660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b5201-8422-49aa-bc66-64759f52fa32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:53.317088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b5201-8422-49aa-bc66-64759f52fa32 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-e36b5201-8422-49aa-bc66-64759f52fa32 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:10:53.330808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:10:53.331980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:10:53.333247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 595/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:10:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:10:53.338387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b090b-d943-4121-a32a-3526b799590b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:53.391971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:53.435884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b090b-d943-4121-a32a-3526b799590b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:53.468984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a96939-3368-4700-8b02-4834a829edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:53.469632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a96939-3368-4700-8b02-4834a829edd0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:53.469915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a96939-3368-4700-8b02-4834a829edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:53.470191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a96939-3368-4700-8b02-4834a829edd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:53.470928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a96939-3368-4700-8b02-4834a829edd0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:10:53.471235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a96939-3368-4700-8b02-4834a829edd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:53.472612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a96939-3368-4700-8b02-4834a829edd0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:53.480388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 571/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 30 10:10:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:55.479511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93404eda-f4b7-4da1-a48a-a1d07b247356 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:55.480044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93404eda-f4b7-4da1-a48a-a1d07b247356 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:55.480044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93404eda-f4b7-4da1-a48a-a1d07b247356 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:55.481449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 596/1167] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:55.486654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd5a5-15aa-4520-aafa-c34a35a06a6f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:55.487107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd5a5-15aa-4520-aafa-c34a35a06a6f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:55.487235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbd5a5-15aa-4520-aafa-c34a35a06a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:55.505157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b4cbd5a5-15aa-4520-aafa-c34a35a06a6f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:55.506331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b4cbd5a5-15aa-4520-aafa-c34a35a06a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:55.578408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 572/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:55.601152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93404eda-f4b7-4da1-a48a-a1d07b247356 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:55.618335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:55.703118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93404eda-f4b7-4da1-a48a-a1d07b247356 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:55.734544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f4b78-5f3b-466a-88f9-a05c210383f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:55.735160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4b78-5f3b-466a-88f9-a05c210383f9 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:55.735442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4b78-5f3b-466a-88f9-a05c210383f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:55.735714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4b78-5f3b-466a-88f9-a05c210383f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:55.736443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f4b78-5f3b-466a-88f9-a05c210383f9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:55.737815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f4b78-5f3b-466a-88f9-a05c210383f9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:55.752343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 597/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Thu Jun 30 10:10:55 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:10:57.771487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000ddf2-85eb-420d-8526-a8eebe1593cf None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:57.771992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000ddf2-85eb-420d-8526-a8eebe1593cf None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:57.771992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000ddf2-85eb-420d-8526-a8eebe1593cf None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:57.773819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 573/1170] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:10:57.778884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0bc34-e61d-420f-9837-0bcf588588e3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:57.779261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0bc34-e61d-420f-9837-0bcf588588e3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:57.779431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0bc34-e61d-420f-9837-0bcf588588e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:57.796423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5be0bc34-e61d-420f-9837-0bcf588588e3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:10:57.797591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5be0bc34-e61d-420f-9837-0bcf588588e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:10:57.861419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 598/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:10:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:10:57.884745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000ddf2-85eb-420d-8526-a8eebe1593cf None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:57.934151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:57.982941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000ddf2-85eb-420d-8526-a8eebe1593cf None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:58.014381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0d41c-04ce-4fb7-8756-88c8ca1ffd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:58.015250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d41c-04ce-4fb7-8756-88c8ca1ffd49 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:58.015534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d41c-04ce-4fb7-8756-88c8ca1ffd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:58.015805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0d41c-04ce-4fb7-8756-88c8ca1ffd49 None admin] PATH_INFO: `/v3/domains/9a58ad94a5de4e64a9bb466701ba9f94` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:58.026314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0d41c-04ce-4fb7-8756-88c8ca1ffd49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9a58ad94a5de4e64a9bb466701ba9f94)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:58.027724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0d41c-04ce-4fb7-8756-88c8ca1ffd49 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:58.029297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 574/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Thu Jun 30 10:10:57 2022] GET /identity/v3/domains/9a58ad94a5de4e64a9bb466701ba9f94 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:10:58.035181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0bc34-e61d-420f-9837-0bcf588588e3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:10:58.038713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:10:58.129429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0bc34-e61d-420f-9837-0bcf588588e3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:10:58.162206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9212-51fa-4227-bc2e-279f6a237568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:10:58.162914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9212-51fa-4227-bc2e-279f6a237568 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:10:58.163200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9212-51fa-4227-bc2e-279f6a237568 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:10:58.163474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9212-51fa-4227-bc2e-279f6a237568 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:10:58.164175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9212-51fa-4227-bc2e-279f6a237568 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:10:58.165596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9212-51fa-4227-bc2e-279f6a237568 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:10:58.189414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 599/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:10:58 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:11:00.261474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19e58-8bf5-4654-87aa-bc95f06cfd89 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:00.262007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19e58-8bf5-4654-87aa-bc95f06cfd89 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:00.262007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b19e58-8bf5-4654-87aa-bc95f06cfd89 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:00.263435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 575/1174] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:11:00.268606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0a26-bf52-4bfc-896e-52266cbd5cc4 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:00.269005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0a26-bf52-4bfc-896e-52266cbd5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:00.269159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0a26-bf52-4bfc-896e-52266cbd5cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:00.286676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b74c0a26-bf52-4bfc-896e-52266cbd5cc4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:11:00.287871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b74c0a26-bf52-4bfc-896e-52266cbd5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:11:00.337517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:00.355497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 600/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:11:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:11:00.380148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b19e58-8bf5-4654-87aa-bc95f06cfd89 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:00.478511 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b19e58-8bf5-4654-87aa-bc95f06cfd89 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:00.488927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:00.512931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7e2e-9688-4ebd-aad8-f33c8d1a90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:00.513716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7e2e-9688-4ebd-aad8-f33c8d1a90a0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:00.513994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7e2e-9688-4ebd-aad8-f33c8d1a90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:00.514264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7e2e-9688-4ebd-aad8-f33c8d1a90a0 None admin] PATH_INFO: `/v3/domains/9a58ad94a5de4e64a9bb466701ba9f94` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:00.515461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7e2e-9688-4ebd-aad8-f33c8d1a90a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9a58ad94a5de4e64a9bb466701ba9f94)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:00.516900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7e2e-9688-4ebd-aad8-f33c8d1a90a0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:00.518511 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 576/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Thu Jun 30 10:11:00 2022] GET /identity/v3/domains/9a58ad94a5de4e64a9bb466701ba9f94 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:00.524235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c0a26-bf52-4bfc-896e-52266cbd5cc4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:00.621904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c0a26-bf52-4bfc-896e-52266cbd5cc4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:00.653523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b959e99-3cba-41a5-8ea3-a0eb75ad5c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:00.654176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b959e99-3cba-41a5-8ea3-a0eb75ad5c5b None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:00.654453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b959e99-3cba-41a5-8ea3-a0eb75ad5c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:00.654749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b959e99-3cba-41a5-8ea3-a0eb75ad5c5b None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:00.655449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b959e99-3cba-41a5-8ea3-a0eb75ad5c5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:00.656866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b959e99-3cba-41a5-8ea3-a0eb75ad5c5b None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:00.676416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 601/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:11:00 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:11:02.724039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b729-6294-45ca-a5ac-ce85811f6804 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:02.724577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b729-6294-45ca-a5ac-ce85811f6804 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:02.724577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b729-6294-45ca-a5ac-ce85811f6804 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:02.725949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 577/1178] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:11:02.731023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f89f3-3eba-4271-ae67-9bcae36b8d95 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:02.731461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f89f3-3eba-4271-ae67-9bcae36b8d95 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:02.731567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f89f3-3eba-4271-ae67-9bcae36b8d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:02.747814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-0d4f89f3-3eba-4271-ae67-9bcae36b8d95 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:11:02.748907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0d4f89f3-3eba-4271-ae67-9bcae36b8d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:11:02.783552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:02.815579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 602/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:11:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:11:02.839780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b729-6294-45ca-a5ac-ce85811f6804 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:02.939946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b729-6294-45ca-a5ac-ce85811f6804 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:02.972847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:02.973614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:02.973890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:02.974159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:02.984448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:11:02.992514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:11:02.993637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:11:02.994751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 578/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:11:02.999623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f89f3-3eba-4271-ae67-9bcae36b8d95 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:03.095316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f89f3-3eba-4271-ae67-9bcae36b8d95 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:03.127789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:03.128431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:03.128714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:03.128991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:03.129727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:11:03.130036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:03.131440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:03.139700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 603/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:03.145188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:03.183433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:03.240540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2563740-1216-4a82-be2e-6afd8280519d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:03.273559 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:03.274329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:03.274607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:03.274906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] PATH_INFO: `/v3/users/1ff02c30d498469b88928aa588f70e8f` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:03.287356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] RBAC: Authorizing `identity:get_user(user_id=1ff02c30d498469b88928aa588f70e8f)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:03.288850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:03.290440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 579/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:11:03 2022] GET /identity/v3/users/1ff02c30d498469b88928aa588f70e8f => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:03.296082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:03.330088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:03.393331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9599-61f2-4830-a107-39415e8bdd99 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:03.425216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:03.425840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:03.426124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:03.426401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:03.490797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:03.492785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:03.523743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:03.590039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 604/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:11:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:11:03.596109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:03.688083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:03.694859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ca3b-4fa7-455c-88a6-aeff3a3660ae None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:03.728311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68215ccf-d103-4ff0-ba14-9cc42a16781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:03.729153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215ccf-d103-4ff0-ba14-9cc42a16781d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:03.729439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215ccf-d103-4ff0-ba14-9cc42a16781d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:03.729719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215ccf-d103-4ff0-ba14-9cc42a16781d None admin] PATH_INFO: `/v3/projects/4aaeb38edfb64096899d20750ee61e26` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:03.730913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68215ccf-d103-4ff0-ba14-9cc42a16781d None admin] RBAC: Authorizing `identity:get_project(project_id=4aaeb38edfb64096899d20750ee61e26)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:03.732348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68215ccf-d103-4ff0-ba14-9cc42a16781d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:03.734020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 580/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:11:03 2022] GET /identity/v3/projects/4aaeb38edfb64096899d20750ee61e26 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:03.740231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:03.834753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39896764-c458-446e-bdb1-8c683c3bfca5 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:03.867858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c3267-4fb5-4b7b-8aae-79cbc4964fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:03.868494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3267-4fb5-4b7b-8aae-79cbc4964fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:03.868773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3267-4fb5-4b7b-8aae-79cbc4964fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:03.869046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3267-4fb5-4b7b-8aae-79cbc4964fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:03.869861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c3267-4fb5-4b7b-8aae-79cbc4964fc9 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=4aaeb38edfb64096899d20750ee61e26, user.id=1ff02c30d498469b88928aa588f70e8f) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:11:03.870171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c3267-4fb5-4b7b-8aae-79cbc4964fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:03.871611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c3267-4fb5-4b7b-8aae-79cbc4964fc9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:03.873338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:03.877383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 605/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:11:03 2022] GET /identity/v3/role_assignments?user.id=1ff02c30d498469b88928aa588f70e8f&scope.project.id=4aaeb38edfb64096899d20750ee61e26&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:05.871015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587436-074b-4be7-8480-57d0e33e5eef None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:05.871525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587436-074b-4be7-8480-57d0e33e5eef None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:05.871525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587436-074b-4be7-8480-57d0e33e5eef None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:05.872856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 581/1186] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:11:05.878118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62edd-2fd1-4cdc-8370-ad295f52de78 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:05.878535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62edd-2fd1-4cdc-8370-ad295f52de78 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:05.878671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62edd-2fd1-4cdc-8370-ad295f52de78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:05.895419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-27a62edd-2fd1-4cdc-8370-ad295f52de78 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:11:05.896580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-27a62edd-2fd1-4cdc-8370-ad295f52de78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:11:05.961458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 606/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:11:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:11:05.984089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587436-074b-4be7-8480-57d0e33e5eef None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:06.081025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587436-074b-4be7-8480-57d0e33e5eef None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:06.112699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:06.113459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:06.113736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:06.114006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:06.124271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:11:06.132233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:11:06.133356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:11:06.134457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 582/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:11:06.139276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62edd-2fd1-4cdc-8370-ad295f52de78 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:06.233415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62edd-2fd1-4cdc-8370-ad295f52de78 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:06.259786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:06.267702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:06.268346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:06.268625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:06.268898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:06.269631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:11:06.269933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:06.271313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:06.279060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 607/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:06.284756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:06.310171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:06.382337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd38e7-2a7b-45dc-af53-78e3d180eb00 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:06.414086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:06.414947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:06.415225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:06.415493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] PATH_INFO: `/v3/users/1ff02c30d498469b88928aa588f70e8f` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:06.416649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] RBAC: Authorizing `identity:get_user(user_id=1ff02c30d498469b88928aa588f70e8f)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:06.418077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:06.419678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 583/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:11:06 2022] GET /identity/v3/users/1ff02c30d498469b88928aa588f70e8f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:06.425275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:06.521586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a1861-3f5d-4949-be74-9b62f65ec581 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:06.553885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc7e0a-3294-4240-bab7-6fb13cdd15ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:06.554743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc7e0a-3294-4240-bab7-6fb13cdd15ee None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:06.555031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc7e0a-3294-4240-bab7-6fb13cdd15ee None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:06.555303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc7e0a-3294-4240-bab7-6fb13cdd15ee None admin] PATH_INFO: `/v3/projects/4aaeb38edfb64096899d20750ee61e26` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:06.556460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc7e0a-3294-4240-bab7-6fb13cdd15ee None admin] RBAC: Authorizing `identity:get_project(project_id=4aaeb38edfb64096899d20750ee61e26)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:06.557863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc7e0a-3294-4240-bab7-6fb13cdd15ee None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:06.559563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 608/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:11:06 2022] GET /identity/v3/projects/4aaeb38edfb64096899d20750ee61e26 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:06.565357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:06.654184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:06.663310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72d377-1875-4939-9f4a-330887274af0 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:06.695994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49847ed9-70ad-41f6-8c75-650afb2be7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:06.696868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49847ed9-70ad-41f6-8c75-650afb2be7c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:06.697149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49847ed9-70ad-41f6-8c75-650afb2be7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:06.697424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49847ed9-70ad-41f6-8c75-650afb2be7c0 None admin] PATH_INFO: `/v3/projects/4aaeb38edfb64096899d20750ee61e26/users/1ff02c30d498469b88928aa588f70e8f/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:06.699357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49847ed9-70ad-41f6-8c75-650afb2be7c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4aaeb38edfb64096899d20750ee61e26, user_id=1ff02c30d498469b88928aa588f70e8f, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:06.700863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49847ed9-70ad-41f6-8c75-650afb2be7c0 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:06.713988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 584/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:11:06 2022] PUT /identity/v3/projects/4aaeb38edfb64096899d20750ee61e26/users/1ff02c30d498469b88928aa588f70e8f/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:11:08.713566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9eef-fcc6-470c-8461-be352643e0f4 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:08.714123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9eef-fcc6-470c-8461-be352643e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:08.714123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9eef-fcc6-470c-8461-be352643e0f4 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:08.715562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 609/1193] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:11:08.720812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35693-bd30-457c-a39e-4b808b965fc9 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:08.721191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35693-bd30-457c-a39e-4b808b965fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:08.721374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d35693-bd30-457c-a39e-4b808b965fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:08.738239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-30d35693-bd30-457c-a39e-4b808b965fc9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:11:08.739507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-30d35693-bd30-457c-a39e-4b808b965fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:11:08.804432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 585/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:11:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:11:08.828269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9eef-fcc6-470c-8461-be352643e0f4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:08.885722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:08.926395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9eef-fcc6-470c-8461-be352643e0f4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:08.958872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:08.961737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:08.962017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:08.962288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:08.972657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:11:08.980172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:11:08.981280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:11:08.982179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 610/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:11:08.987389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d35693-bd30-457c-a39e-4b808b965fc9 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:09.065361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:09.084163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d35693-bd30-457c-a39e-4b808b965fc9 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:09.116589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:09.117235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:09.117518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:09.117790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:09.118522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:11:09.118854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:09.120219 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:09.127946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 586/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:09.134280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:09.228761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a2042-ab20-4758-a894-9da648e36614 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:09.245390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:09.261983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:09.262853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:09.263131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:09.263398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] PATH_INFO: `/v3/users/1ff02c30d498469b88928aa588f70e8f` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:09.264551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] RBAC: Authorizing `identity:get_user(user_id=1ff02c30d498469b88928aa588f70e8f)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:09.265973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:09.267605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 611/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 30 10:11:09 2022] GET /identity/v3/users/1ff02c30d498469b88928aa588f70e8f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:09.273215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:09.370855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937bb6d-131b-4882-becb-13df63d1c1d7 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:09.402379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:09.403030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:09.403310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:09.403583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:09.417610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:09.470465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:09.471959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:09.566949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 587/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:11:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:11:09.573862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:09.670906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee1567-ef60-46c5-adf7-5e039cc45287 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:09.704351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21cd65-9589-4e76-90e8-b422dbfd91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:09.705195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21cd65-9589-4e76-90e8-b422dbfd91e5 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:09.705482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21cd65-9589-4e76-90e8-b422dbfd91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:09.705758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21cd65-9589-4e76-90e8-b422dbfd91e5 None admin] PATH_INFO: `/v3/projects/4aaeb38edfb64096899d20750ee61e26` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:09.706963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21cd65-9589-4e76-90e8-b422dbfd91e5 None admin] RBAC: Authorizing `identity:get_project(project_id=4aaeb38edfb64096899d20750ee61e26)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:09.708398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21cd65-9589-4e76-90e8-b422dbfd91e5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:09.710714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 612/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 30 10:11:09 2022] GET /identity/v3/projects/4aaeb38edfb64096899d20750ee61e26 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:09.716866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:11:09.761683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:09.814393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715451d7-2a95-497f-9fa1-453288959bf1 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:11:09.847840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e3263-29cd-460b-9477-43273fc0f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:11:09.848478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e3263-29cd-460b-9477-43273fc0f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:11:09.848762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e3263-29cd-460b-9477-43273fc0f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:11:09.849039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e3263-29cd-460b-9477-43273fc0f9c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:11:09.849859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e3263-29cd-460b-9477-43273fc0f9c7 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=4aaeb38edfb64096899d20750ee61e26, user.id=1ff02c30d498469b88928aa588f70e8f) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:11:09.850174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e3263-29cd-460b-9477-43273fc0f9c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:11:09.851632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e3263-29cd-460b-9477-43273fc0f9c7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:11:09.857284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 588/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:11:09 2022] GET /identity/v3/role_assignments?user.id=1ff02c30d498469b88928aa588f70e8f&scope.project.id=4aaeb38edfb64096899d20750ee61e26&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:11:19.700264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=73 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:11:19.854808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=46 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:04.878472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3b253-53c4-4a4f-9710-1daf8dc8d728 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:04.879597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3b253-53c4-4a4f-9710-1daf8dc8d728 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:04.879597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3b253-53c4-4a4f-9710-1daf8dc8d728 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:04.880943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 613/1201] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:04.887183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac94760-cf78-4519-83f5-d43e7c9e1411 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:04.887677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac94760-cf78-4519-83f5-d43e7c9e1411 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:04.887765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac94760-cf78-4519-83f5-d43e7c9e1411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:04.906881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-bac94760-cf78-4519-83f5-d43e7c9e1411 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:04.908304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-bac94760-cf78-4519-83f5-d43e7c9e1411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:04.996779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 589/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 10:12:05.024226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3b253-53c4-4a4f-9710-1daf8dc8d728 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:05.159970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3b253-53c4-4a4f-9710-1daf8dc8d728 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:05.205608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:05.206819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:05.208050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:05.208543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:05.221035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:05.222727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:05.243469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:05.244766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:05.245941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:05.245941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:05.245941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:05.245941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:05.245941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 614/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:05.253165 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac94760-cf78-4519-83f5-d43e7c9e1411 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:05.384897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac94760-cf78-4519-83f5-d43e7c9e1411 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:05.417789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:05.424296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c501bb2-3ee7-4842-9b99-03b8e453305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:05.425350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c501bb2-3ee7-4842-9b99-03b8e453305d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:05.426487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c501bb2-3ee7-4842-9b99-03b8e453305d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:05.426989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c501bb2-3ee7-4842-9b99-03b8e453305d None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:05.427717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c501bb2-3ee7-4842-9b99-03b8e453305d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:05.428026 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c501bb2-3ee7-4842-9b99-03b8e453305d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:05.429711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c501bb2-3ee7-4842-9b99-03b8e453305d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:05.442589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 590/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:05.449400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:05.519776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:05.591714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2e3fd-6e63-44f3-9f08-838565710b5f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:05.637237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130bec8-cada-42e5-9980-21603f6f8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:05.637994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130bec8-cada-42e5-9980-21603f6f8da5 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:05.638278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130bec8-cada-42e5-9980-21603f6f8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:05.638635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130bec8-cada-42e5-9980-21603f6f8da5 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:05.639531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130bec8-cada-42e5-9980-21603f6f8da5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:05.641126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130bec8-cada-42e5-9980-21603f6f8da5 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:05.666218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 615/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 30 10:12:05 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:12:07.855641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8f8e6-b2ea-4e91-81a1-020230dc4400 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:07.856164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8f8e6-b2ea-4e91-81a1-020230dc4400 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:07.856164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8f8e6-b2ea-4e91-81a1-020230dc4400 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:07.857832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 591/1206] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:07.865980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60f12-3be4-478d-883c-c58e7604fab9 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:07.866558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60f12-3be4-478d-883c-c58e7604fab9 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:07.866558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60f12-3be4-478d-883c-c58e7604fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:07.886385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1eb60f12-3be4-478d-883c-c58e7604fab9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:07.887805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1eb60f12-3be4-478d-883c-c58e7604fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:07.984023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 616/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:08.009015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8f8e6-b2ea-4e91-81a1-020230dc4400 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:08.133644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8f8e6-b2ea-4e91-81a1-020230dc4400 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:08.172557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:08.173430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:08.173795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:08.174178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:08.185732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:12:08.194201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:08.195544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:08.196431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 592/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:08.201657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60f12-3be4-478d-883c-c58e7604fab9 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:08.249233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:08.324317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60f12-3be4-478d-883c-c58e7604fab9 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:08.359712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:08.360387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:08.360818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:08.360944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:08.361680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:08.361994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:08.363978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:08.372700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 617/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:08.378741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:08.435721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:08.492159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180141f-674a-44cb-9e78-699adcbdc831 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:08.531313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:08.532166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:08.532389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:08.532660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:08.544803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:08.546509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:08.567109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:08.568174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:08.575856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:08.575856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:08.575856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:08.575856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:08.575856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 593/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:08.576200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:08.682866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:08.685812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871cc66-bbd2-4299-b302-858a59f9c204 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:08.725942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:08.726609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:08.726931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:08.727212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:08.727944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:08.728263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:08.729683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:08.743378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 618/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:08.748960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:08.869645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd90b8-797d-42ba-a8b8-2b15f516a037 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:08.871424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:08.912046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:08.913403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:08.913688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:08.914047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:08.922135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:08.923855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:12:08.940524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:08.942071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:08.943104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 594/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:08.949829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:09.070623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1001998-a3f2-4493-81fa-292a5bc9294a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:09.114769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:09.115611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:09.115892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:09.116166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:09.117072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:09.117390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:09.119132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:09.144184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 619/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 30 10:12:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:09.151938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:09.278279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311f410-123e-4af6-ad3a-cd72ea5603d2 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:09.320832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:09.321881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:09.322199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:09.322649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:09.360712 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:09.408096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:09.409549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:09.544707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 595/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:12:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:12:09.550354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:09.572622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:09.663592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d1a40-9bf3-431c-984a-c28a991f2ed9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:09.701256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:09.702051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:09.702338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:09.702616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:09.714402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:09.715937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:09.735091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:09.736293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:09.742111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:09.742111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:09.742111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:09.742111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:09.742111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 620/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:09.742456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:09.814503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:09.861947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef975983-7385-438f-b219-c7661d6fec59 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:09.898781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:09.899480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:09.900620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:09.900620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:09.900813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:09.901039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:09.902465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:09.920851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 596/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:12:09.921701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:10.005633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:10.040492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334967f-0b77-4b82-a698-de089e53192e None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:10.084219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:10.084789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:10.085075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:10.085346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:10.093282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:10.094832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:12:10.110665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:10.111732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:10.112638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 621/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:10.118968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:10.229534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539529f-721e-429c-bc2f-c3339447358d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:10.256075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:10.271699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3286f3-2296-4b0a-9c1e-e43c8024d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:10.272531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3286f3-2296-4b0a-9c1e-e43c8024d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:10.272882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3286f3-2296-4b0a-9c1e-e43c8024d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:10.273229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3286f3-2296-4b0a-9c1e-e43c8024d8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:10.274091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3286f3-2296-4b0a-9c1e-e43c8024d8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:10.274477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3286f3-2296-4b0a-9c1e-e43c8024d8f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:10.276011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3286f3-2296-4b0a-9c1e-e43c8024d8f4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:10.292987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 597/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:10.300267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:10.412094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33c246-a1d5-4bf7-89d9-6a3896cb8dfc None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:10.443060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:10.449576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c31e5-c1e5-4d88-81bc-cd6343f944eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:10.450253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c31e5-c1e5-4d88-81bc-cd6343f944eb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:10.450536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c31e5-c1e5-4d88-81bc-cd6343f944eb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:10.450841 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c31e5-c1e5-4d88-81bc-cd6343f944eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:10.451699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c31e5-c1e5-4d88-81bc-cd6343f944eb None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=888cdfc6fbf94f02bd671b67280d767f) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:10.452010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c31e5-c1e5-4d88-81bc-cd6343f944eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:10.453425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c31e5-c1e5-4d88-81bc-cd6343f944eb None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:10.461468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 622/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:12:10 2022] GET /identity/v3/role_assignments?user.id=888cdfc6fbf94f02bd671b67280d767f&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:12.548980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feb15c-437e-4836-9b40-e06113ceddac None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:12.549620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feb15c-437e-4836-9b40-e06113ceddac None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:12.549620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feb15c-437e-4836-9b40-e06113ceddac None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:12.550923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 598/1220] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:12.556788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2ae6-9b09-41a7-a26b-db279c39d1cf None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:12.557254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2ae6-9b09-41a7-a26b-db279c39d1cf None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:12.557458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e2ae6-9b09-41a7-a26b-db279c39d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:12.575143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a59e2ae6-9b09-41a7-a26b-db279c39d1cf None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:12.576350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a59e2ae6-9b09-41a7-a26b-db279c39d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:12.646420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 623/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:12.671962 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6feb15c-437e-4836-9b40-e06113ceddac None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:12.784391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6feb15c-437e-4836-9b40-e06113ceddac None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:12.820077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:12.820873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:12.821155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:12.821428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:12.831886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:12:12.839566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:12.840897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:12.841870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 599/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:12.847529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2ae6-9b09-41a7-a26b-db279c39d1cf None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:12.949836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e2ae6-9b09-41a7-a26b-db279c39d1cf None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:12.972926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:12.983964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:12.984633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:12.984919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:12.985197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:12.986037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:12.986296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:12.987710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:12.997532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 624/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:13.003535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:13.056531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:13.122270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2724d-7877-4c59-bb10-e84a6d235570 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:13.159044 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:13.160355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:13.160634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:13.160902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:13.171248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:13.172701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:13.190056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:13.191204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:13.192471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:13.192471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:13.192471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:13.192471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:13.192471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 600/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:13.198261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:13.305686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726df8fe-595a-4688-aca9-4d875f9ab2e9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:13.339376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:13.339979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:13.340260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:13.340557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:13.341298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:13.341605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:13.343115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:13.356848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 625/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:13.362465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:13.462672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:13.469637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936574a-758b-4d61-98b7-fcd72233544c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:13.506490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:13.507361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:13.507647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:13.507949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:13.516230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:13.517691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:12:13.532441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:13.533551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:13.535389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:13.538890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 601/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:13.540471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:13.591365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:13.647333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446417c-0fc0-483c-9fa2-2a49f4efd120 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:13.685015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:13.685753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:13.686055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:13.686332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:13.687240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:13.687553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:13.689108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:13.709416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 626/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 30 10:12:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:13.716032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:13.828160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca78c9-5b90-45c7-998f-db195897979b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:13.862792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:13.863531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:13.863810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:13.864084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:13.874997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:13.876488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:13.896567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:13.897781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:13.899116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:13.899116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:13.899116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:13.899116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:13.902840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 602/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:13.904704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:14.010556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e88a3-88d5-4a58-a0b1-3e48a70f5a41 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:14.013204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:14.049355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:14.050054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:14.050362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:14.050713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:14.051426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:14.051734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:14.053092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:14.068808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 627/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:12:14.075302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:14.086229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:14.190152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c0e0-aaf9-4472-bb86-a83386441a67 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:14.237582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:14.238969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:14.239257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:14.239533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:14.246974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:14.248617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:12:14.264617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:14.265711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:14.266830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:14.271009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 603/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:14.272119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:14.386519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d8d8e-7ad9-4d00-b79c-0ab0d142421d None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:14.427557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b30fb3-015c-418b-973e-564b6f53eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:14.428318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b30fb3-015c-418b-973e-564b6f53eb98 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:14.428648 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b30fb3-015c-418b-973e-564b6f53eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:14.428932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b30fb3-015c-418b-973e-564b6f53eb98 None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:14.429866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b30fb3-015c-418b-973e-564b6f53eb98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:14.430225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b30fb3-015c-418b-973e-564b6f53eb98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:14.431730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b30fb3-015c-418b-973e-564b6f53eb98 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:14.444301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 628/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:14.451066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:14.522611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:14.558886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226400e-aa10-4dbe-bcf1-d01593a4b656 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:14.598900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6c50a-0ca5-489f-9567-8862fc283853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:14.599792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c50a-0ca5-489f-9567-8862fc283853 None admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:14.600074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c50a-0ca5-489f-9567-8862fc283853 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:14.600351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c50a-0ca5-489f-9567-8862fc283853 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/888cdfc6fbf94f02bd671b67280d767f/roles/343c9b57a593491fb88af31c81cda9ed` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:14.615757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6c50a-0ca5-489f-9567-8862fc283853 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=888cdfc6fbf94f02bd671b67280d767f, role_id=343c9b57a593491fb88af31c81cda9ed)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:14.617308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6c50a-0ca5-489f-9567-8862fc283853 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:14.630525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 604/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:12:14 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/888cdfc6fbf94f02bd671b67280d767f/roles/343c9b57a593491fb88af31c81cda9ed => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:12:16.747149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783873d-7304-4433-9f6f-89e10c8265c7 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:16.747807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783873d-7304-4433-9f6f-89e10c8265c7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:16.747807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783873d-7304-4433-9f6f-89e10c8265c7 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:16.749289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 629/1233] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:16.755182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c831b0-c71d-46fe-8f0f-453649db2f79 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:16.755642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c831b0-c71d-46fe-8f0f-453649db2f79 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:16.755741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c831b0-c71d-46fe-8f0f-453649db2f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:16.771783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-13c831b0-c71d-46fe-8f0f-453649db2f79 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:16.772973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-13c831b0-c71d-46fe-8f0f-453649db2f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:16.848463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 605/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:16.872572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783873d-7304-4433-9f6f-89e10c8265c7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:16.898644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:16.981049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783873d-7304-4433-9f6f-89e10c8265c7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:17.021365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:17.022070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:17.022352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:17.022625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:17.032733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:12:17.041184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:17.042317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:17.043423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 630/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 30 10:12:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:17.049115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c831b0-c71d-46fe-8f0f-453649db2f79 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:17.099008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:17.158307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c831b0-c71d-46fe-8f0f-453649db2f79 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:17.198244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:17.199089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:17.199399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:17.199681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:17.200454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] RBAC: Adding query filter params (name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:17.200895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:17.202337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:17.213433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 606/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 30 10:12:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:17.220214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:17.329226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:17.346895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38970e-e0a9-4b26-8b0a-30d169438325 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:17.385486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:17.386722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:17.386969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:17.387466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:17.400553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:17.402444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:17.421224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:17.422330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:17.427970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:17.427970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:17.427970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:17.427970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:17.427970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 631/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:12:17.428768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:17.535861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446aa9-fa67-4ed1-9bff-b4edc5707ada None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:17.546085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:17.577314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:17.577994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:17.578274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:17.578546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:17.579366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:17.579619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:17.581006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:17.596164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 607/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:17.603243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:17.717981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7e1e1-c096-427d-82da-8a30baaac716 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:17.754516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:17.755353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:17.755718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:17.755934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:17.759554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:17.765405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:17.766985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:12:17.783551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:17.785120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:17.786235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 632/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:12:17.791718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:17.902622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458b160-e2d8-4880-a224-f069ead5a11e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:17.938293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:17.938989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:17.939277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:17.939556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:17.940390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:17.940728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:17.942173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:17.961755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 608/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 30 10:12:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:12:17.968392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:18.079415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae844bf-0d84-44b7-8ed0-6a3587e45ab9 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:18.120219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:18.121147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:18.121434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:18.121702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:18.188773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:18.196496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:18.198789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:18.331271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 633/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:12:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:12:18.337673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:18.365310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:18.443449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626e37-d90e-44b0-8f89-2336e19a8c6d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:18.482987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:18.483796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:18.484084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:18.484374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:18.497857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:18.499713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:18.521633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:18.522795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:18.523893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:18.523893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:18.523893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:18.523893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:18.523893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 609/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:18.530241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:18.635749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:18.642828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228db3cc-05e6-4a0d-b9ec-512f2b48a4f3 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:18.680448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:18.681107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:18.681388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:18.681664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:18.682374 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:18.682692 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:18.684162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:18.696191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 634/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:12:18.702450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:18.794839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:18.820223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78220a-773e-440d-b618-f185cc940ef5 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:18.862297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:18.863426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:18.863719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:18.864041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:18.871657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:18.873134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:12:18.887901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:18.889077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:18.890961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 610/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:18.896398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:19.001679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc6ec3-0462-4c46-a188-8692257b9d68 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:19.038982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be715285-c304-40f0-9e66-92f79170a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:19.039815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715285-c304-40f0-9e66-92f79170a93d None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:19.040128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715285-c304-40f0-9e66-92f79170a93d None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:19.040418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715285-c304-40f0-9e66-92f79170a93d None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:19.041338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be715285-c304-40f0-9e66-92f79170a93d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:19.041646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be715285-c304-40f0-9e66-92f79170a93d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:19.043161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be715285-c304-40f0-9e66-92f79170a93d None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:19.056246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 635/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:19.062920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:19.172437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5e689-53e4-4c5c-97c7-b0de099a75d8 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:19.212582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2f7a5-a8e5-49f9-946e-4bea5d92fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:19.213455 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2f7a5-a8e5-49f9-946e-4bea5d92fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:19.213814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2f7a5-a8e5-49f9-946e-4bea5d92fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:19.214157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2f7a5-a8e5-49f9-946e-4bea5d92fdf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:19.215432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2f7a5-a8e5-49f9-946e-4bea5d92fdf2 None admin] RBAC: Adding query filter params (role.id=343c9b57a593491fb88af31c81cda9ed, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=888cdfc6fbf94f02bd671b67280d767f) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:19.215786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2f7a5-a8e5-49f9-946e-4bea5d92fdf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:19.217510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2f7a5-a8e5-49f9-946e-4bea5d92fdf2 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:19.224999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 611/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:12:19 2022] GET /identity/v3/role_assignments?user.id=888cdfc6fbf94f02bd671b67280d767f&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=343c9b57a593491fb88af31c81cda9ed => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:12:21.520159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdea5d-78d8-427e-97f4-710837542c68 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:21.520730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdea5d-78d8-427e-97f4-710837542c68 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:21.520730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdea5d-78d8-427e-97f4-710837542c68 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:21.522220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 636/1247] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:21.528070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59421f3-24a0-4e9d-92a0-798be702b561 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:21.528620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59421f3-24a0-4e9d-92a0-798be702b561 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:21.528620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59421f3-24a0-4e9d-92a0-798be702b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:21.533934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:21.547685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b59421f3-24a0-4e9d-92a0-798be702b561 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:21.549169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b59421f3-24a0-4e9d-92a0-798be702b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:21.624030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 612/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:21.649924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdea5d-78d8-427e-97f4-710837542c68 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:21.668704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:21.764290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdea5d-78d8-427e-97f4-710837542c68 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:21.805173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:21.806096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:21.806455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:21.806769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:21.820523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:12:21.829047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:21.830189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:21.831265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 637/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:21.838143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59421f3-24a0-4e9d-92a0-798be702b561 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:21.948133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59421f3-24a0-4e9d-92a0-798be702b561 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:21.979555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:21.985512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70209e-7103-493c-b002-72b33796293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:21.986402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70209e-7103-493c-b002-72b33796293b None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:21.986703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70209e-7103-493c-b002-72b33796293b None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:21.987011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70209e-7103-493c-b002-72b33796293b None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:21.988259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70209e-7103-493c-b002-72b33796293b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:21.988565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70209e-7103-493c-b002-72b33796293b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:21.990071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70209e-7103-493c-b002-72b33796293b None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:21.998971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 613/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:22.009598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:22.096309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:22.126859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f437cbc-1391-4382-b705-410f738c2004 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:22.161274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:22.162079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:22.162337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:22.162607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:22.173233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:22.174761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:22.195043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:22.196321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:22.197573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:22.197573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:22.197573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:22.197573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:22.199359 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 638/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:22.206128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70209e-7103-493c-b002-72b33796293b None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:22.320365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70209e-7103-493c-b002-72b33796293b None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:22.358586 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:22.359269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:22.359550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:22.359821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:22.360627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:22.361034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:22.363314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:22.377123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 614/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:22.382727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:22.498388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6955e-4d37-4777-bbf8-45cdf7a6b6ee None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:22.530825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:22.539832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:22.540628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:22.540910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:22.541184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:22.550822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:22.552359 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:12:22.568025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:22.569595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:22.570746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 639/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:22.575261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:22.638164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:22.689120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224e711-71f8-4397-90b2-5b06e3951d3c None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:22.728216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:22.728962 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:22.729324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:22.729659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:22.730678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:22.731095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:22.732790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:22.755076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 615/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 30 10:12:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:22.761001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:22.875556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859924c4-cc9b-43f4-8a8d-4d56611dc00a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:22.913056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:22.913697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:22.913980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:22.914254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:22.974131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:22.986650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:22.988740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:23.097421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 640/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:12:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:12:23.103732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:23.220589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caac350-f678-458e-9260-9ec84b8e2ee3 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:23.237643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:23.261828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:23.262645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:23.262990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:23.263332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:23.275177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:23.276829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:23.296128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:23.297325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:23.298381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:23.298381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:23.298381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:23.298381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:23.298381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 616/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:23.303258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:23.401236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:23.417537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435832-6fef-41a0-a1ea-3251a2cdb707 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:23.453445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:23.454098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:23.454379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:23.454652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:23.455391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:23.455697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:23.457594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:23.468958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 641/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:23.475933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:23.589900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d096-b25e-4eab-9abd-0eb9c556a4ae None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:23.627253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:23.628820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:23.629115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:23.629391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:23.637310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:23.638918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:12:23.654117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:23.655239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:23.656481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 617/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:23.661606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:23.769398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5cba5-bec1-4ac2-a93a-4d6f5d6886ca None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:23.804530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217c55-2f7a-491a-94d4-47b3b519d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:23.805184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217c55-2f7a-491a-94d4-47b3b519d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:23.805464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217c55-2f7a-491a-94d4-47b3b519d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:23.805736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217c55-2f7a-491a-94d4-47b3b519d2aa None admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:23.806506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217c55-2f7a-491a-94d4-47b3b519d2aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:23.806844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217c55-2f7a-491a-94d4-47b3b519d2aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:23.808513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217c55-2f7a-491a-94d4-47b3b519d2aa None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:23.821501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 642/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:23.829018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:23.855820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:23.935688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def64d0-959e-4303-ab0a-58c3fdcea16e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:23.972592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d7b4-8413-4004-bbe0-bbf123bdfca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:23.973535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d7b4-8413-4004-bbe0-bbf123bdfca7 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:23.973859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d7b4-8413-4004-bbe0-bbf123bdfca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:23.974151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d7b4-8413-4004-bbe0-bbf123bdfca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:23.975060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d7b4-8413-4004-bbe0-bbf123bdfca7 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=888cdfc6fbf94f02bd671b67280d767f) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:23.975374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d7b4-8413-4004-bbe0-bbf123bdfca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:23.976965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d7b4-8413-4004-bbe0-bbf123bdfca7 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:23.982640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 618/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:12:23 2022] GET /identity/v3/role_assignments?user.id=888cdfc6fbf94f02bd671b67280d767f&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:26.014143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bcf7e-00df-44b8-a77a-33843a3a7f94 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:26.014667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bcf7e-00df-44b8-a77a-33843a3a7f94 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:26.014791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bcf7e-00df-44b8-a77a-33843a3a7f94 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:26.016098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 643/1261] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:26.021172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3b70a-d394-4406-971d-797df73f3e19 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:26.021587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3b70a-d394-4406-971d-797df73f3e19 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:26.021727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3b70a-d394-4406-971d-797df73f3e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:26.039881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-2bd3b70a-d394-4406-971d-797df73f3e19 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:26.041064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2bd3b70a-d394-4406-971d-797df73f3e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:26.105539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 619/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:26.128605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bcf7e-00df-44b8-a77a-33843a3a7f94 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:26.139274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:26.247081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bcf7e-00df-44b8-a77a-33843a3a7f94 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:26.281179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:26.281897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:26.282180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:26.282458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:26.292846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:12:26.300931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:26.301999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:26.303100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 644/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 10:12:26.308220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3b70a-d394-4406-971d-797df73f3e19 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:26.326834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:26.404625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3b70a-d394-4406-971d-797df73f3e19 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:26.437298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:26.437953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:26.438237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:26.438514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:26.439277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:26.439584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:26.441485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:26.449517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 620/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:26.455111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:26.520000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:26.553198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323f46-5c50-4952-bbb6-36016adacf4f None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:26.585865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:26.586637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:26.586950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:26.587227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:26.597825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:26.599303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:26.616235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:26.617254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:26.618354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:26.618354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:26.618354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:26.618354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:26.618354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 645/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:26.623260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:26.702248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:26.720999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a662e-b8bb-418c-9457-6a01a39e2671 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:26.753935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:26.754582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:26.754896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:26.755172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:26.755884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:26.756191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:26.757564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:26.768963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 621/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:26.774484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:26.871620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd37b4-c9aa-4fad-9bc5-f4f3f8e07c99 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:26.890165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:26.904028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:26.904815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:26.905098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:26.905372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:26.913127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:26.914546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:12:26.928957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:26.930041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:26.931406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 646/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:26.935908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:27.036625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b698-9783-490d-b8b6-9560718d9138 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:27.068730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:27.069640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:27.069921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:27.070195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:27.071046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:27.071355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:27.072785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:27.081601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:27.090477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 622/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 30 10:12:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:27.096202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:27.193575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ca1ad-a8eb-4a97-bce9-da2d4c8f23d0 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:27.233668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:27.234563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:27.234983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:27.235280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:27.247568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:27.248992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:27.265445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:27.266485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:27.267757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:27.267757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:27.267757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:27.267757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:27.267757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 647/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:27.272941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:27.373489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781b79e-a229-4b85-973e-82a089a99733 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:27.405446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:27.406084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:27.406361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:27.406632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:27.407364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:27.407663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:27.409538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:27.420341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 623/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:27.426384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:27.456868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:27.522569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18792e-5585-4660-942f-95ae16d9a887 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:27.555721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:27.556496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:27.556786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:27.557058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:27.563667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:27.565117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:12:27.579926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:27.580959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:27.581910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 648/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:27.586857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:27.644024 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:27.684880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052a923-beeb-4d34-951f-7883ff722ffa None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:27.717462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d48c6c-36b1-4754-a22c-aeaf8227cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:27.718051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48c6c-36b1-4754-a22c-aeaf8227cbee None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:27.718331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48c6c-36b1-4754-a22c-aeaf8227cbee None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:27.718605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48c6c-36b1-4754-a22c-aeaf8227cbee None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:27.719409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d48c6c-36b1-4754-a22c-aeaf8227cbee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:27.719719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d48c6c-36b1-4754-a22c-aeaf8227cbee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:27.721144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d48c6c-36b1-4754-a22c-aeaf8227cbee None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:27.733315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 624/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:27.739283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:27.826604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:27.836144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82a833-27f8-4477-af42-73771e2af103 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:27.869070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e11c9-0f3c-4c78-ad50-484535befdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:27.869933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e11c9-0f3c-4c78-ad50-484535befdb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:27.870214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e11c9-0f3c-4c78-ad50-484535befdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:27.870506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e11c9-0f3c-4c78-ad50-484535befdb4 None admin] PATH_INFO: `/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/888cdfc6fbf94f02bd671b67280d767f/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:27.872457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e11c9-0f3c-4c78-ad50-484535befdb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1ef6188696e4bcf8810f1ba4ddbfe21, user_id=888cdfc6fbf94f02bd671b67280d767f, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:27.873890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e11c9-0f3c-4c78-ad50-484535befdb4 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:27.886351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 649/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 30 10:12:27 2022] PUT /identity/v3/projects/a1ef6188696e4bcf8810f1ba4ddbfe21/users/888cdfc6fbf94f02bd671b67280d767f/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:12:29.876352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49259b-fdb9-4edf-9d11-58d59f09c6c4 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:29.876864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49259b-fdb9-4edf-9d11-58d59f09c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:29.876864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49259b-fdb9-4edf-9d11-58d59f09c6c4 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:29.878779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 625/1274] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:29.883868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fdcb5-e8b9-447e-9407-32e4027c61a5 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:29.884248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fdcb5-e8b9-447e-9407-32e4027c61a5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:29.884420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fdcb5-e8b9-447e-9407-32e4027c61a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:29.901239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-074fdcb5-e8b9-447e-9407-32e4027c61a5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:29.902439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-074fdcb5-e8b9-447e-9407-32e4027c61a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:29.966836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 650/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:29.990320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49259b-fdb9-4edf-9d11-58d59f09c6c4 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:30.089552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49259b-fdb9-4edf-9d11-58d59f09c6c4 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:30.106998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:30.123603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:30.124373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:30.124649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:30.124917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:30.135244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 10:12:30.142563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:30.143540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:30.144421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 626/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 30 10:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:30.149870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fdcb5-e8b9-447e-9407-32e4027c61a5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:30.234808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:30.255396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fdcb5-e8b9-447e-9407-32e4027c61a5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:30.288286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:30.288939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:30.289217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:30.289486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:30.290217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:30.290521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:30.291913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:30.300258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 651/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 30 10:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:30.305858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:30.404298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aa7db-51c9-40e4-a110-207362907183 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:30.437333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:30.438102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:30.438391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:30.438667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:30.449220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:30.450659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:30.467188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:30.468218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:30.469322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:30.469322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:30.469322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:30.469322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:30.469322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 627/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:30.474612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:30.571757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c0271-5a4f-4523-b0a2-3c4e9f81e904 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:30.603986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:30.604632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:30.604916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:30.605195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:30.605909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:30.606217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:30.607594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:30.619505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 652/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:30.624997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:30.655076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:30.723563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac561-c612-4da5-971c-409300ce76a4 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:30.755450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:30.756229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:30.756515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:30.756792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:30.763992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:30.765472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 10:12:30.779829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:30.780737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:30.781753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 628/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:30.787155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:30.790877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:30.883828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb27a2a-ee5f-41c7-b564-59881a088b0c None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:30.916928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:30.917514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:30.917794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:30.918065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:30.918908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:30.919212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:30.920611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:30.937629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 653/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 30 10:12:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:30.943215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:31.032007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:31.042493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2ca5-9be7-4705-974d-3f58ee24f60d None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:31.075960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:31.076591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:31.076875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:31.077150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:31.141416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:31.142882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:31.235604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:31.246484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 629/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 30 10:12:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 10:12:31.252211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:31.310757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:31.349077 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a35f4-df51-4e70-bd46-9c403e4c5798 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:31.382187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:31.382992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:31.383283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:31.383562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:31.393304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:31.394767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 10:12:31.412441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:31.413510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:31.414598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 10:12:31.414598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 10:12:31.414598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 10:12:31.414598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:31.414598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 654/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:31.419300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:31.522411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e458f0-3398-46df-8869-deef7a08f995 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:31.555470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:31.556121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:31.556405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:31.556683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:31.557396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:31.557702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:31.559104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:31.570284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 630/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 30 10:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:31.575863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:31.675991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a887a37-ce4a-4936-82f3-0e633b6be0ca None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:31.689508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:31.709990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:31.710819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:31.711098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:31.711366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:31.717775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:31.719236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 10:12:31.733363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:31.734392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: ERROR keystone.server.flask.application Jun 30 10:12:31.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 655/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 30 10:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:31.740501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:31.789180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:31.838870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc01e-1bc2-4330-ad92-8fbde0aa86ec None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:31.870430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4392f-b4ac-4c7c-8327-a282c74bd9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:31.871099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4392f-b4ac-4c7c-8327-a282c74bd9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:31.871380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4392f-b4ac-4c7c-8327-a282c74bd9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:31.871650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4392f-b4ac-4c7c-8327-a282c74bd9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:31.872421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4392f-b4ac-4c7c-8327-a282c74bd9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:31.872726 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4392f-b4ac-4c7c-8327-a282c74bd9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:31.874153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4392f-b4ac-4c7c-8327-a282c74bd9a5 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:31.886264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 631/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 30 10:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:31.892175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:31.990484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b653bc-89cf-40e5-b10c-e4aa4095203a None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:32.024082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff5e3b-cd6a-4852-830a-cb64052eee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:32.024667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff5e3b-cd6a-4852-830a-cb64052eee19 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:32.024956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff5e3b-cd6a-4852-830a-cb64052eee19 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:32.025238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff5e3b-cd6a-4852-830a-cb64052eee19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:32.026062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff5e3b-cd6a-4852-830a-cb64052eee19 None admin] RBAC: Adding query filter params (role.id=cf54c1867a54448f8977c8d3d9494b48, scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21, user.id=888cdfc6fbf94f02bd671b67280d767f) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:32.026377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff5e3b-cd6a-4852-830a-cb64052eee19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:32.027840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff5e3b-cd6a-4852-830a-cb64052eee19 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:32.033547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 656/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 30 10:12:31 2022] GET /identity/v3/role_assignments?user.id=888cdfc6fbf94f02bd671b67280d767f&scope.project.id=a1ef6188696e4bcf8810f1ba4ddbfe21&role.id=cf54c1867a54448f8977c8d3d9494b48 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:34.045642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849330-c7df-4095-997f-7ecae8d49c91 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:34.046194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849330-c7df-4095-997f-7ecae8d49c91 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:34.046194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849330-c7df-4095-997f-7ecae8d49c91 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:34.047575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 632/1288] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:34.052682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f566ef-d7ca-4c76-aa69-4b27981a743d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:34.053071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f566ef-d7ca-4c76-aa69-4b27981a743d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:34.053242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f566ef-d7ca-4c76-aa69-4b27981a743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:34.070452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-81f566ef-d7ca-4c76-aa69-4b27981a743d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:34.071688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-81f566ef-d7ca-4c76-aa69-4b27981a743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:34.100568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:34.136826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 657/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:34.159681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849330-c7df-4095-997f-7ecae8d49c91 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:34.276594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849330-c7df-4095-997f-7ecae8d49c91 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:34.290175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:34.313661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:34.314386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:34.314665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:34.315467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:34.316113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:34.317479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:34.329237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:34.330476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:34.331922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 633/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:12:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:34.337001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f566ef-d7ca-4c76-aa69-4b27981a743d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:34.431088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f566ef-d7ca-4c76-aa69-4b27981a743d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:34.464314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e9a5c-e38e-4b67-ae9d-f76bf48277fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:34.464955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e9a5c-e38e-4b67-ae9d-f76bf48277fb None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:34.465264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e9a5c-e38e-4b67-ae9d-f76bf48277fb None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:34.465539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e9a5c-e38e-4b67-ae9d-f76bf48277fb None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:34.466232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e9a5c-e38e-4b67-ae9d-f76bf48277fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:34.466535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e9a5c-e38e-4b67-ae9d-f76bf48277fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:34.467921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e9a5c-e38e-4b67-ae9d-f76bf48277fb None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:34.472601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 658/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 30 10:12:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:34.478211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:34.576196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc743-833a-4edd-9043-f8823d15929e None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:34.607560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334fe4a-a8b2-4fcf-ad61-62d5b875a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:34.608203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fe4a-a8b2-4fcf-ad61-62d5b875a0ad None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:34.608482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fe4a-a8b2-4fcf-ad61-62d5b875a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:34.608754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fe4a-a8b2-4fcf-ad61-62d5b875a0ad None admin] PATH_INFO: `/v3/services` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:34.609444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334fe4a-a8b2-4fcf-ad61-62d5b875a0ad None admin] RBAC: Adding query filter params (type=placement) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:34.609744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334fe4a-a8b2-4fcf-ad61-62d5b875a0ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:34.611138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334fe4a-a8b2-4fcf-ad61-62d5b875a0ad None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:34.615920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 634/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 30 10:12:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:36.607168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e740-1433-4978-b6bd-83007db71ccc None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:36.607673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e740-1433-4978-b6bd-83007db71ccc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:36.607759 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e740-1433-4978-b6bd-83007db71ccc None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:36.609083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 659/1293] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:36.614072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f0b66-a86d-4453-9e7a-7149a5501b87 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:36.614443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f0b66-a86d-4453-9e7a-7149a5501b87 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:36.614632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f0b66-a86d-4453-9e7a-7149a5501b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:36.631485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-226f0b66-a86d-4453-9e7a-7149a5501b87 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:36.632669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-226f0b66-a86d-4453-9e7a-7149a5501b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:36.661769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:36.698654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 635/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:36.721857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e740-1433-4978-b6bd-83007db71ccc None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:36.752064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:36.821553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e740-1433-4978-b6bd-83007db71ccc None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:36.853495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdabd5-658c-4b50-9870-be22dbeaa153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:36.854127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdabd5-658c-4b50-9870-be22dbeaa153 None admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:36.854405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdabd5-658c-4b50-9870-be22dbeaa153 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:36.854677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdabd5-658c-4b50-9870-be22dbeaa153 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:36.855414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdabd5-658c-4b50-9870-be22dbeaa153 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:36.856757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdabd5-658c-4b50-9870-be22dbeaa153 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:36.869893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 660/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 30 10:12:36 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:12:38.889976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb16a42-b4d5-42b1-a50a-2775783d8e86 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:38.890479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb16a42-b4d5-42b1-a50a-2775783d8e86 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:38.890479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb16a42-b4d5-42b1-a50a-2775783d8e86 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:38.891840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 636/1296] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:38.896855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992d87-3b71-491b-9cd6-a9b7441cdc6b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:38.897276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992d87-3b71-491b-9cd6-a9b7441cdc6b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:38.897408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69992d87-3b71-491b-9cd6-a9b7441cdc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:38.914060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-69992d87-3b71-491b-9cd6-a9b7441cdc6b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:38.915245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-69992d87-3b71-491b-9cd6-a9b7441cdc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:38.984473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 661/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:39.007095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb16a42-b4d5-42b1-a50a-2775783d8e86 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:39.105805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb16a42-b4d5-42b1-a50a-2775783d8e86 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:39.138821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:39.139599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:39.139882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:39.140207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:39.140813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:39.142192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:39.154158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:39.155360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:39.156414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 637/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:12:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:39.161807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992d87-3b71-491b-9cd6-a9b7441cdc6b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:39.179626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:39.261098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69992d87-3b71-491b-9cd6-a9b7441cdc6b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:39.294814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:39.295472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:39.295756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:39.296036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:39.296736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:39.297046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:39.298412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:39.303578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 662/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 30 10:12:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:39.309377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:39.341112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:39.408020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959de50-9dba-4d6a-a069-a970bbaf9f20 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:39.440222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6f0a9-dc97-48ec-a992-0d12400748ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:39.440864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f0a9-dc97-48ec-a992-0d12400748ca None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:39.441146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f0a9-dc97-48ec-a992-0d12400748ca None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:39.441421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6f0a9-dc97-48ec-a992-0d12400748ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:39.442195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6f0a9-dc97-48ec-a992-0d12400748ca None admin] RBAC: Adding query filter params (interface=public, service_id=db7b940bdd90400dad5c3b96ed7f2ef5, region_id=RegionOne) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:39.442506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6f0a9-dc97-48ec-a992-0d12400748ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:39.444167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6f0a9-dc97-48ec-a992-0d12400748ca None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:39.449041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 638/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 30 10:12:39 2022] GET /identity/v3/endpoints?service_id=db7b940bdd90400dad5c3b96ed7f2ef5&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:39.454540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:39.533606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:39.551772 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd49dd-47fc-4b01-93eb-4d5db14566c8 None admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:39.584963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da36ad-7a42-41f4-bdff-03793e94e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:39.585612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da36ad-7a42-41f4-bdff-03793e94e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:39.585901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da36ad-7a42-41f4-bdff-03793e94e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:39.586178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da36ad-7a42-41f4-bdff-03793e94e7b7 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:39.586884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da36ad-7a42-41f4-bdff-03793e94e7b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:39.588247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da36ad-7a42-41f4-bdff-03793e94e7b7 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:39.594927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 663/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 30 10:12:39 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:12:41.585730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0de6b-f251-4ce3-98c3-781654304365 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:41.586226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0de6b-f251-4ce3-98c3-781654304365 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:41.586316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0de6b-f251-4ce3-98c3-781654304365 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:41.587753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 639/1302] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:12:41.592903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2ea2-e0c1-4932-a163-019ae5d6ca17 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:41.593337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2ea2-e0c1-4932-a163-019ae5d6ca17 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:41.593466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a2ea2-e0c1-4932-a163-019ae5d6ca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:41.609826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c33a2ea2-e0c1-4932-a163-019ae5d6ca17 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:12:41.611035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c33a2ea2-e0c1-4932-a163-019ae5d6ca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:12:41.674502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 664/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:12:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 10:12:41.697645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0de6b-f251-4ce3-98c3-781654304365 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:41.790623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:41.797630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0de6b-f251-4ce3-98c3-781654304365 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:41.831001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:41.831788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:41.832071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:41.832347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:41.833221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:41.834972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 10:12:41.847076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 10:12:41.848259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application with Lock( Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self._enter() Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application return self.creator() Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application created_value = creator( Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: ERROR keystone.server.flask.application Jun 30 10:12:41.849448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 640/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 30 10:12:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 10:12:41.854232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2ea2-e0c1-4932-a163-019ae5d6ca17 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:41.926770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:41.950031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a2ea2-e0c1-4932-a163-019ae5d6ca17 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:41.982867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce7e4-20da-48dd-941c-7714badfb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:41.983514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce7e4-20da-48dd-941c-7714badfb165 None admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:41.983799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce7e4-20da-48dd-941c-7714badfb165 None admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:41.984076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce7e4-20da-48dd-941c-7714badfb165 None admin] PATH_INFO: `/v3/services` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:41.984774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce7e4-20da-48dd-941c-7714badfb165 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:12:41.985082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce7e4-20da-48dd-941c-7714badfb165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:41.986969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce7e4-20da-48dd-941c-7714badfb165 None admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:41.992035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 665/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 30 10:12:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:12:41.997625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:12:42.095123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293a3f2-5074-4dc6-8b5a-f2d92af9e120 None admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:12:42.128277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cfcc6-d501-45d8-a322-6f010e070d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:12:42.128920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cfcc6-d501-45d8-a322-6f010e070d69 None admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:12:42.129205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cfcc6-d501-45d8-a322-6f010e070d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:12:42.129482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cfcc6-d501-45d8-a322-6f010e070d69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:12:42.130212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cfcc6-d501-45d8-a322-6f010e070d69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:12:42.131616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cfcc6-d501-45d8-a322-6f010e070d69 None admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:12:42.148981 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 641/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 30 10:12:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:12:51.988998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=30 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:12:52.144656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:44.586800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17977-4941-4020-88db-9e5b85071834 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:44.587824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17977-4941-4020-88db-9e5b85071834 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:44.588315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b17977-4941-4020-88db-9e5b85071834 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:44.596394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2dec8-ebd0-4c33-9f56-eb72275d77c7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:44.597358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2dec8-ebd0-4c33-9f56-eb72275d77c7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:44.598070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2dec8-ebd0-4c33-9f56-eb72275d77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:44.602658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 666/1307] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:13:44 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:13:44.689199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8ad2dec8-ebd0-4c33-9f56-eb72275d77c7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:13:44.690407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8ad2dec8-ebd0-4c33-9f56-eb72275d77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:44.897439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 642/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:13:44.964974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49699-7614-41b2-b8b2-2548e2dfb8cc None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:44.965259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49699-7614-41b2-b8b2-2548e2dfb8cc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:44.965816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49699-7614-41b2-b8b2-2548e2dfb8cc None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:44.968087 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 667/1309] 10.222.0.44 () {54 vars in 964 bytes} [Thu Jun 30 10:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:13:44.986060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a0e3-1ef0-4ea8-a2f3-75ce1b6bbf1c None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:44.986664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a0e3-1ef0-4ea8-a2f3-75ce1b6bbf1c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:44.987304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a0e3-1ef0-4ea8-a2f3-75ce1b6bbf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:45.114487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f7f3a0e3-1ef0-4ea8-a2f3-75ce1b6bbf1c None None] MFA Rules not processed for user `c11a44c395ae45fcba4e0c0fe08695c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:13:45.115719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f7f3a0e3-1ef0-4ea8-a2f3-75ce1b6bbf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:45.138566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:45.236863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 643/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Thu Jun 30 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:13:45.245568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49699-7614-41b2-b8b2-2548e2dfb8cc None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:13:45.247744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0fe49699-7614-41b2-b8b2-2548e2dfb8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:45.405938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49699-7614-41b2-b8b2-2548e2dfb8cc None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:13:45.504035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac8c69-4d3b-4bc9-bfef-59c38ee0b658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:13:45.504689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c69-4d3b-4bc9-bfef-59c38ee0b658 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:45.504968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c69-4d3b-4bc9-bfef-59c38ee0b658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:45.505360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac8c69-4d3b-4bc9-bfef-59c38ee0b658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:45.507035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9cac8c69-4d3b-4bc9-bfef-59c38ee0b658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:45.569639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:45.632656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac8c69-4d3b-4bc9-bfef-59c38ee0b658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:13:45.635011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac8c69-4d3b-4bc9-bfef-59c38ee0b658 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:13:45.655618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 668/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:13:47.998548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091b0a-1884-42da-999d-e0ea18173ca2 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:47.999206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091b0a-1884-42da-999d-e0ea18173ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:47.999206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091b0a-1884-42da-999d-e0ea18173ca2 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:48.000492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 644/1312] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:13:48.005706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70267da4-3018-4bc6-a772-2aa4a8608062 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:48.006138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70267da4-3018-4bc6-a772-2aa4a8608062 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:48.006274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70267da4-3018-4bc6-a772-2aa4a8608062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:48.087605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-70267da4-3018-4bc6-a772-2aa4a8608062 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:13:48.088850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-70267da4-3018-4bc6-a772-2aa4a8608062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:48.187658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 669/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:13:48.227083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091b0a-1884-42da-999d-e0ea18173ca2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:13:48.228645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ae091b0a-1884-42da-999d-e0ea18173ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:48.339567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091b0a-1884-42da-999d-e0ea18173ca2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:13:48.412167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:48.415567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5e21-5784-421d-b26c-20481a7bd8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:13:48.416471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5e21-5784-421d-b26c-20481a7bd8cf service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:48.417194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5e21-5784-421d-b26c-20481a7bd8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:48.417715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5e21-5784-421d-b26c-20481a7bd8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:48.420616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7fab5e21-5784-421d-b26c-20481a7bd8cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:48.535386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5e21-5784-421d-b26c-20481a7bd8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:13:48.536837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5e21-5784-421d-b26c-20481a7bd8cf service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:13:48.555436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 645/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:13:50.878858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ffe38-76b9-4aa6-8e73-c6865a5db4c7 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:50.879388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ffe38-76b9-4aa6-8e73-c6865a5db4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:50.879388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ffe38-76b9-4aa6-8e73-c6865a5db4c7 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:50.880719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 670/1315] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:13:50.885853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739ef0-1aba-4179-8db4-f57b4b2f8d06 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:50.886258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739ef0-1aba-4179-8db4-f57b4b2f8d06 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:50.886410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739ef0-1aba-4179-8db4-f57b4b2f8d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:50.951340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-78739ef0-1aba-4179-8db4-f57b4b2f8d06 None None] MFA Rules not processed for user `f4d8dca6da814ed3aee97c9b23323a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:13:50.952532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-78739ef0-1aba-4179-8db4-f57b4b2f8d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:51.003511 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:51.047506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 646/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:13:51.089143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ffe38-76b9-4aa6-8e73-c6865a5db4c7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:13:51.090709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-125ffe38-76b9-4aa6-8e73-c6865a5db4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:51.100942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:51.194218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ffe38-76b9-4aa6-8e73-c6865a5db4c7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:13:51.264989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447819ad-ea6e-45a4-8e48-6f99bf026fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:13:51.265624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447819ad-ea6e-45a4-8e48-6f99bf026fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:51.265905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447819ad-ea6e-45a4-8e48-6f99bf026fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:51.266179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447819ad-ea6e-45a4-8e48-6f99bf026fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:51.267850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-447819ad-ea6e-45a4-8e48-6f99bf026fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:51.327907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:51.375254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447819ad-ea6e-45a4-8e48-6f99bf026fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:13:51.376725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447819ad-ea6e-45a4-8e48-6f99bf026fcd service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:13:51.394335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 671/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:13:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:13:53.976408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232232-5a6f-49cf-9626-540224c80b89 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:53.977088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232232-5a6f-49cf-9626-540224c80b89 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:53.977088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41232232-5a6f-49cf-9626-540224c80b89 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:53.978317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 647/1318] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:13:53.983843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662175d-4618-4181-9058-79f3d451e649 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:53.984250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662175d-4618-4181-9058-79f3d451e649 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:53.984415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662175d-4618-4181-9058-79f3d451e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:54.048387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d662175d-4618-4181-9058-79f3d451e649 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:13:54.049602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d662175d-4618-4181-9058-79f3d451e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:54.144430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 672/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:13:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:13:54.182922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232232-5a6f-49cf-9626-540224c80b89 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:13:54.184450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-41232232-5a6f-49cf-9626-540224c80b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:54.287955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41232232-5a6f-49cf-9626-540224c80b89 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:13:54.359928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e329a6-b6c3-467a-8023-6a24fa08682c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:13:54.360565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e329a6-b6c3-467a-8023-6a24fa08682c service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:54.360848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e329a6-b6c3-467a-8023-6a24fa08682c service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:54.361123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e329a6-b6c3-467a-8023-6a24fa08682c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:54.362788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-45e329a6-b6c3-467a-8023-6a24fa08682c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:54.370005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:54.468657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e329a6-b6c3-467a-8023-6a24fa08682c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:13:54.470092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e329a6-b6c3-467a-8023-6a24fa08682c service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:13:54.488460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 648/1320] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:13:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:13:57.180755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55937-af60-4b4c-91c2-d2d19feadabc None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:57.181331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55937-af60-4b4c-91c2-d2d19feadabc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:57.181331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55937-af60-4b4c-91c2-d2d19feadabc None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:57.182729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 673/1321] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:13:57.187896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d5d50-2670-48c1-9455-d4b031dddae5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:57.188318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d5d50-2670-48c1-9455-d4b031dddae5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:57.188459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d5d50-2670-48c1-9455-d4b031dddae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:57.254629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-963d5d50-2670-48c1-9455-d4b031dddae5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:13:57.255852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-963d5d50-2670-48c1-9455-d4b031dddae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:57.320068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:57.364264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 649/1322] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:13:57.400160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf55937-af60-4b4c-91c2-d2d19feadabc None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:13:57.401867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-abf55937-af60-4b4c-91c2-d2d19feadabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:57.423134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:57.514507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf55937-af60-4b4c-91c2-d2d19feadabc None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:13:57.586706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da8f54-647c-43f8-8052-78c8cf8dcf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:13:57.587349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da8f54-647c-43f8-8052-78c8cf8dcf23 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:57.587631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da8f54-647c-43f8-8052-78c8cf8dcf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:57.587934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da8f54-647c-43f8-8052-78c8cf8dcf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:57.589571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-95da8f54-647c-43f8-8052-78c8cf8dcf23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:57.661161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:13:57.699762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da8f54-647c-43f8-8052-78c8cf8dcf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:13:57.701672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da8f54-647c-43f8-8052-78c8cf8dcf23 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:13:57.723028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 674/1323] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:13:59.793437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7683e-5baf-4a77-988d-0196a146da74 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:59.793948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7683e-5baf-4a77-988d-0196a146da74 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:59.793948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7683e-5baf-4a77-988d-0196a146da74 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:59.795318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 650/1324] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:13:59.800849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d9fe-c12b-497a-923a-682efe137b9b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:13:59.801290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d9fe-c12b-497a-923a-682efe137b9b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:13:59.801416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23d9fe-c12b-497a-923a-682efe137b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:13:59.866044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-0f23d9fe-c12b-497a-923a-682efe137b9b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:13:59.867268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0f23d9fe-c12b-497a-923a-682efe137b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:13:59.963270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 675/1325] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:13:59.999006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7683e-5baf-4a77-988d-0196a146da74 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:00.000620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9bf7683e-5baf-4a77-988d-0196a146da74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:00.101689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7683e-5baf-4a77-988d-0196a146da74 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:00.177791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f085a1-fa49-4991-bde0-e7187a08412e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:00.178432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f085a1-fa49-4991-bde0-e7187a08412e service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:00.178805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f085a1-fa49-4991-bde0-e7187a08412e service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:00.179086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f085a1-fa49-4991-bde0-e7187a08412e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:00.180716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-14f085a1-fa49-4991-bde0-e7187a08412e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:00.197894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:00.290317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f085a1-fa49-4991-bde0-e7187a08412e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:00.291800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f085a1-fa49-4991-bde0-e7187a08412e service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:00.310134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 651/1326] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:02.387997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9916018-3750-4a7b-a151-c89120ced9f0 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:02.389064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9916018-3750-4a7b-a151-c89120ced9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:02.389064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9916018-3750-4a7b-a151-c89120ced9f0 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:02.390484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 676/1327] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:02.395695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d47f9-d35f-4d09-8138-3143a4708734 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:02.396105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d47f9-d35f-4d09-8138-3143a4708734 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:02.396258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d47f9-d35f-4d09-8138-3143a4708734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:02.462630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-be2d47f9-d35f-4d09-8138-3143a4708734 None None] MFA Rules not processed for user `f4d8dca6da814ed3aee97c9b23323a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:02.463819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-be2d47f9-d35f-4d09-8138-3143a4708734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:02.530741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:02.565119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 652/1328] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:02.603335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9916018-3750-4a7b-a151-c89120ced9f0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:02.604903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f9916018-3750-4a7b-a151-c89120ced9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:02.636382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:02.711175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9916018-3750-4a7b-a151-c89120ced9f0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:02.789160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f37dc-180c-414d-99bd-87eb6afc8458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:02.789807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f37dc-180c-414d-99bd-87eb6afc8458 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:02.790088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f37dc-180c-414d-99bd-87eb6afc8458 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:02.790360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f37dc-180c-414d-99bd-87eb6afc8458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:02.792071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ab3f37dc-180c-414d-99bd-87eb6afc8458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:02.870068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:02.902830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f37dc-180c-414d-99bd-87eb6afc8458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:02.904279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f37dc-180c-414d-99bd-87eb6afc8458 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:02.922901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 677/1329] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:05.204628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045b5e-2473-417e-ad15-b08d141fd0d0 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:05.205184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045b5e-2473-417e-ad15-b08d141fd0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:05.205184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045b5e-2473-417e-ad15-b08d141fd0d0 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:05.206537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 653/1330] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:05.211784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3920a1-427c-4993-b775-b4afec5b1aec None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:05.212194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3920a1-427c-4993-b775-b4afec5b1aec None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:05.212338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3920a1-427c-4993-b775-b4afec5b1aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:05.275674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bf3920a1-427c-4993-b775-b4afec5b1aec None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:05.276871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bf3920a1-427c-4993-b775-b4afec5b1aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:05.370594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 678/1331] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:14:05.409257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045b5e-2473-417e-ad15-b08d141fd0d0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:05.410859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-66045b5e-2473-417e-ad15-b08d141fd0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:05.513747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045b5e-2473-417e-ad15-b08d141fd0d0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:05.584638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fc5cc-f4ae-4727-96b0-0ec21b06036c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:05.585279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc5cc-f4ae-4727-96b0-0ec21b06036c service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:05.585561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc5cc-f4ae-4727-96b0-0ec21b06036c service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:05.585838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc5cc-f4ae-4727-96b0-0ec21b06036c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:05.587497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1d2fc5cc-f4ae-4727-96b0-0ec21b06036c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:05.614133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:05.694401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fc5cc-f4ae-4727-96b0-0ec21b06036c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:05.695918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fc5cc-f4ae-4727-96b0-0ec21b06036c service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:05.713423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 654/1332] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:07.778439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777de5-132a-4049-b011-6af955857c9f None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:07.778978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777de5-132a-4049-b011-6af955857c9f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:07.778978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777de5-132a-4049-b011-6af955857c9f None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:07.780364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 679/1333] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:07.785432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61315b21-0404-4e23-84e8-a456fde4ac23 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:07.785856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61315b21-0404-4e23-84e8-a456fde4ac23 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:07.785989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61315b21-0404-4e23-84e8-a456fde4ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:07.850180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-61315b21-0404-4e23-84e8-a456fde4ac23 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:07.851402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-61315b21-0404-4e23-84e8-a456fde4ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:07.924809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:07.947271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 655/1334] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:07.987605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8777de5-132a-4049-b011-6af955857c9f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:07.989185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f8777de5-132a-4049-b011-6af955857c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:08.027737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:08.090236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8777de5-132a-4049-b011-6af955857c9f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:08.162110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b63a21-7637-48b4-8231-21dd4b4507d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:08.162784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b63a21-7637-48b4-8231-21dd4b4507d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:08.163072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b63a21-7637-48b4-8231-21dd4b4507d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:08.163351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b63a21-7637-48b4-8231-21dd4b4507d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:08.165019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-65b63a21-7637-48b4-8231-21dd4b4507d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:08.246966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:08.272411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b63a21-7637-48b4-8231-21dd4b4507d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:08.273864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b63a21-7637-48b4-8231-21dd4b4507d1 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:08.291795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 680/1335] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:10.616234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e14fa7-1495-4b74-954e-6cd6a64a943e None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:10.616624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e14fa7-1495-4b74-954e-6cd6a64a943e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:10.616794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e14fa7-1495-4b74-954e-6cd6a64a943e None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:10.618163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 656/1336] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:10.623455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece689-1aba-4f44-af5c-75614df46d67 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:10.623847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece689-1aba-4f44-af5c-75614df46d67 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:10.624016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece689-1aba-4f44-af5c-75614df46d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:10.687260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bfece689-1aba-4f44-af5c-75614df46d67 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:10.688464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bfece689-1aba-4f44-af5c-75614df46d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:10.784326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 681/1337] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:10.820668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e14fa7-1495-4b74-954e-6cd6a64a943e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:10.822266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d8e14fa7-1495-4b74-954e-6cd6a64a943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:10.926810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e14fa7-1495-4b74-954e-6cd6a64a943e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:11.002117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ab6d3-ba60-4b38-b62e-a23d4a36b58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:11.002824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab6d3-ba60-4b38-b62e-a23d4a36b58b service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:11.003103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab6d3-ba60-4b38-b62e-a23d4a36b58b service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:11.003377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab6d3-ba60-4b38-b62e-a23d4a36b58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:11.005056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9e6ab6d3-ba60-4b38-b62e-a23d4a36b58b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:11.040926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:11.113113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ab6d3-ba60-4b38-b62e-a23d4a36b58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:11.114559 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ab6d3-ba60-4b38-b62e-a23d4a36b58b service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:11.132658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 657/1338] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:15.027556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508ea53-597f-478b-9d70-44e0a3b1430a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:15.028655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508ea53-597f-478b-9d70-44e0a3b1430a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:15.028655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508ea53-597f-478b-9d70-44e0a3b1430a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:15.030190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 682/1339] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:15.035429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24719a8-df78-4c7e-83ac-9a0a03176424 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:15.035908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24719a8-df78-4c7e-83ac-9a0a03176424 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:15.036007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24719a8-df78-4c7e-83ac-9a0a03176424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:15.108075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c24719a8-df78-4c7e-83ac-9a0a03176424 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:15.109180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c24719a8-df78-4c7e-83ac-9a0a03176424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:15.204376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:15.224160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 658/1340] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:15.263377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508ea53-597f-478b-9d70-44e0a3b1430a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:15.266173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d508ea53-597f-478b-9d70-44e0a3b1430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:15.315305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:15.359851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508ea53-597f-478b-9d70-44e0a3b1430a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:15.372327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effa1de-818a-4747-8f32-b7733e12a95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:15.372960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa1de-818a-4747-8f32-b7733e12a95b service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:15.373240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa1de-818a-4747-8f32-b7733e12a95b service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:15.373509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa1de-818a-4747-8f32-b7733e12a95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:15.382240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effa1de-818a-4747-8f32-b7733e12a95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:15.383697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effa1de-818a-4747-8f32-b7733e12a95b service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:15.394156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 683/1341] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:14:18.068892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d69d1-0034-496a-ab3a-226d07e60592 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:18.069491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d69d1-0034-496a-ab3a-226d07e60592 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:18.069491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d69d1-0034-496a-ab3a-226d07e60592 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:18.070820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 659/1342] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:18.076652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdc8cf-5cb1-4cc7-a12f-02c9e2794872 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:18.077110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdc8cf-5cb1-4cc7-a12f-02c9e2794872 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:18.077332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdc8cf-5cb1-4cc7-a12f-02c9e2794872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:18.104986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b0fdc8cf-5cb1-4cc7-a12f-02c9e2794872 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:18.106199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b0fdc8cf-5cb1-4cc7-a12f-02c9e2794872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:18.188346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 684/1343] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:18.228274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d69d1-0034-496a-ab3a-226d07e60592 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:18.249556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d69d1-0034-496a-ab3a-226d07e60592 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:18.253227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd53e-7583-4c5f-a38f-a0e99d7dfc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:18.253876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd53e-7583-4c5f-a38f-a0e99d7dfc5a service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:18.254159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd53e-7583-4c5f-a38f-a0e99d7dfc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:18.254434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd53e-7583-4c5f-a38f-a0e99d7dfc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:18.264762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cd53e-7583-4c5f-a38f-a0e99d7dfc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:18.266225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cd53e-7583-4c5f-a38f-a0e99d7dfc5a service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:18.276551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 660/1344] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:22.277238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f68d8-d0b3-46fe-8de6-e36a11986ab5 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:22.277832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f68d8-d0b3-46fe-8de6-e36a11986ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:22.277832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f68d8-d0b3-46fe-8de6-e36a11986ab5 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:22.279230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 685/1345] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:22.284659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0b17-de61-4c9e-a6a8-4f6dc03f670d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:22.285135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0b17-de61-4c9e-a6a8-4f6dc03f670d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:22.285230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0b17-de61-4c9e-a6a8-4f6dc03f670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:22.303268 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ef9e0b17-de61-4c9e-a6a8-4f6dc03f670d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:22.304468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ef9e0b17-de61-4c9e-a6a8-4f6dc03f670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:22.314085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 661/1346] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:22.368238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71239-f0a2-4211-93c6-c688f8acef37 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:22.368530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71239-f0a2-4211-93c6-c688f8acef37 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:22.368807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f71239-f0a2-4211-93c6-c688f8acef37 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:22.370187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 686/1347] 10.222.0.44 () {54 vars in 964 bytes} [Thu Jun 30 10:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:14:22.376531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed62a7-4e55-48a2-baa5-818132205436 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:22.376820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed62a7-4e55-48a2-baa5-818132205436 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:22.377098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed62a7-4e55-48a2-baa5-818132205436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:22.435046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f5ed62a7-4e55-48a2-baa5-818132205436 None None] MFA Rules not processed for user `c11a44c395ae45fcba4e0c0fe08695c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:22.436260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f5ed62a7-4e55-48a2-baa5-818132205436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:22.443740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 662/1348] 10.222.0.44 () {58 vars in 1061 bytes} [Thu Jun 30 10:14:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:22.452838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71239-f0a2-4211-93c6-c688f8acef37 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:22.463768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f71239-f0a2-4211-93c6-c688f8acef37 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:22.467346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a6c83-4a3c-44fc-9e19-a7f3bf3244b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:22.467991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a6c83-4a3c-44fc-9e19-a7f3bf3244b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:22.468426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a6c83-4a3c-44fc-9e19-a7f3bf3244b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:22.468547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a6c83-4a3c-44fc-9e19-a7f3bf3244b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:22.485080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a6c83-4a3c-44fc-9e19-a7f3bf3244b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:22.486638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a6c83-4a3c-44fc-9e19-a7f3bf3244b0 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:22.497228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 687/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:27.824870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c87cd3-20bc-44cf-8e04-30b52101622c None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:27.825311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c87cd3-20bc-44cf-8e04-30b52101622c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:27.825405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c87cd3-20bc-44cf-8e04-30b52101622c None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:27.827338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 663/1350] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:27.832416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819a50-993f-4183-b310-78e5d66df48d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:27.832856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819a50-993f-4183-b310-78e5d66df48d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:27.833365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819a50-993f-4183-b310-78e5d66df48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:27.891817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9a819a50-993f-4183-b310-78e5d66df48d None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:27.893259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9a819a50-993f-4183-b310-78e5d66df48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:27.935036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:27.999147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 688/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:32.213442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd87b-e9bd-4d73-aa61-4ee232becd61 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:32.213987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd87b-e9bd-4d73-aa61-4ee232becd61 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:32.213987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd87b-e9bd-4d73-aa61-4ee232becd61 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:32.216188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 664/1352] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:32.221177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588b1e-d7be-4bf9-a751-9130a2ba5f37 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:32.221615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588b1e-d7be-4bf9-a751-9130a2ba5f37 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:32.221770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588b1e-d7be-4bf9-a751-9130a2ba5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:32.241446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-25588b1e-d7be-4bf9-a751-9130a2ba5f37 None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:32.242633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-25588b1e-d7be-4bf9-a751-9130a2ba5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:32.251447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 689/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:32.432112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=34 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:33.894083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab51a1-d74c-4917-a71c-1b096ea889dd None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:33.895033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab51a1-d74c-4917-a71c-1b096ea889dd None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:33.895315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab51a1-d74c-4917-a71c-1b096ea889dd None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:33.896989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 665/1354] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:33.901687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b03ab-955b-42ab-a1c6-df227711629b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:33.902117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b03ab-955b-42ab-a1c6-df227711629b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:33.902411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b03ab-955b-42ab-a1c6-df227711629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:33.921160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-481b03ab-955b-42ab-a1c6-df227711629b None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:33.922345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-481b03ab-955b-42ab-a1c6-df227711629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:33.931012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 690/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:14:37.485716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ba44-fac3-457c-aecd-f3a631efe2c2 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:37.486240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ba44-fac3-457c-aecd-f3a631efe2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:37.486240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ba44-fac3-457c-aecd-f3a631efe2c2 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:37.488274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 666/1356] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:37.494173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed34a-cc8d-4d1d-9584-ad9ca604c9a2 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:37.495228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed34a-cc8d-4d1d-9584-ad9ca604c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:37.496207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ed34a-cc8d-4d1d-9584-ad9ca604c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:37.515411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-816ed34a-cc8d-4d1d-9584-ad9ca604c9a2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:37.516687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-816ed34a-cc8d-4d1d-9584-ad9ca604c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:37.524603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 691/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:37.582076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9269-8b4c-463a-b98a-97438af9f9fc None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:37.582810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9269-8b4c-463a-b98a-97438af9f9fc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:37.583309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9269-8b4c-463a-b98a-97438af9f9fc None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:37.585263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 667/1358] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 30 10:14:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:37.595654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079db2-b4d1-48ef-b9f1-318c79316243 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:37.596624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079db2-b4d1-48ef-b9f1-318c79316243 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:37.598034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079db2-b4d1-48ef-b9f1-318c79316243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:37.654139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-50079db2-b4d1-48ef-b9f1-318c79316243 None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:37.655354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-50079db2-b4d1-48ef-b9f1-318c79316243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:37.741954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 692/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 30 10:14:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:14:37.749833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9269-8b4c-463a-b98a-97438af9f9fc None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:37.765419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9269-8b4c-463a-b98a-97438af9f9fc None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:37.779032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad65f5-9414-471a-9696-51ed0fc16f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:37.780270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad65f5-9414-471a-9696-51ed0fc16f6b service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:37.780919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad65f5-9414-471a-9696-51ed0fc16f6b service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:37.781394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad65f5-9414-471a-9696-51ed0fc16f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:37.792874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad65f5-9414-471a-9696-51ed0fc16f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:37.795032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad65f5-9414-471a-9696-51ed0fc16f6b service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:37.807012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 668/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:40.035348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f9aab-fb72-4510-923f-feeae618b5e0 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:40.035889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f9aab-fb72-4510-923f-feeae618b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:40.035889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f9aab-fb72-4510-923f-feeae618b5e0 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:40.037316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 693/1361] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:40.042352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bdca4-d497-4da5-aaa3-6cf874582095 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:40.042785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bdca4-d497-4da5-aaa3-6cf874582095 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:40.042940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bdca4-d497-4da5-aaa3-6cf874582095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:40.061204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-808bdca4-d497-4da5-aaa3-6cf874582095 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:40.062608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-808bdca4-d497-4da5-aaa3-6cf874582095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:40.075048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 669/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:40.115753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f9aab-fb72-4510-923f-feeae618b5e0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:40.130547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f9aab-fb72-4510-923f-feeae618b5e0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:40.136734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117bd3-8f85-49a0-99b3-b7e27cec7167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:40.137540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117bd3-8f85-49a0-99b3-b7e27cec7167 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:40.137991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117bd3-8f85-49a0-99b3-b7e27cec7167 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:40.138417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117bd3-8f85-49a0-99b3-b7e27cec7167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:40.147375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117bd3-8f85-49a0-99b3-b7e27cec7167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:40.149143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117bd3-8f85-49a0-99b3-b7e27cec7167 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:40.159870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 694/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:14:42.528908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e9d7-58fe-4b0e-ba2b-6a7b4329ece7 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:42.529448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e9d7-58fe-4b0e-ba2b-6a7b4329ece7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:42.529448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e9d7-58fe-4b0e-ba2b-6a7b4329ece7 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:42.531159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 670/1364] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:42.540352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a95e-730c-41ca-a25e-759a242fdaf2 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:42.541204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a95e-730c-41ca-a25e-759a242fdaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:42.541677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667a95e-730c-41ca-a25e-759a242fdaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:42.562031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4667a95e-730c-41ca-a25e-759a242fdaf2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:42.563427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4667a95e-730c-41ca-a25e-759a242fdaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:42.571709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 695/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:42.617753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e16e-6127-445b-91e0-32a2dbd6997b None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:42.618117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e16e-6127-445b-91e0-32a2dbd6997b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:42.618478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e16e-6127-445b-91e0-32a2dbd6997b None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:42.620011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 671/1366] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 30 10:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:42.625119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a0f0-adcf-4d42-a4a4-3b352ce797e9 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:42.625503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a0f0-adcf-4d42-a4a4-3b352ce797e9 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:42.625838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4a0f0-adcf-4d42-a4a4-3b352ce797e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:42.644186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-7cf4a0f0-adcf-4d42-a4a4-3b352ce797e9 None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:42.645435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7cf4a0f0-adcf-4d42-a4a4-3b352ce797e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:42.655233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 696/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 30 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:42.663029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129e16e-6127-445b-91e0-32a2dbd6997b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:42.678058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129e16e-6127-445b-91e0-32a2dbd6997b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:42.683522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9064a-a2a4-4508-a94d-f3dda1f15826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:42.684161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9064a-a2a4-4508-a94d-f3dda1f15826 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:42.684445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9064a-a2a4-4508-a94d-f3dda1f15826 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:42.684723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9064a-a2a4-4508-a94d-f3dda1f15826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:42.693124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9064a-a2a4-4508-a94d-f3dda1f15826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:42.694736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9064a-a2a4-4508-a94d-f3dda1f15826 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:42.704656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 672/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:44.801675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f874b5f-4127-4560-81ac-4cf7481acac8 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:44.802178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f874b5f-4127-4560-81ac-4cf7481acac8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:44.802178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f874b5f-4127-4560-81ac-4cf7481acac8 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:44.803699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 697/1369] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:44.809251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a63029-18fa-4325-a1df-d1a27a48b976 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:44.809681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a63029-18fa-4325-a1df-d1a27a48b976 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:44.809885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a63029-18fa-4325-a1df-d1a27a48b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:44.829796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-76a63029-18fa-4325-a1df-d1a27a48b976 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:44.831108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-76a63029-18fa-4325-a1df-d1a27a48b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:44.846888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 673/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:14:44.884719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f874b5f-4127-4560-81ac-4cf7481acac8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:44.900228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f874b5f-4127-4560-81ac-4cf7481acac8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:44.906052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a3ab5-abf0-4b9c-9d5e-e2f28c96653d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:44.906919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3ab5-abf0-4b9c-9d5e-e2f28c96653d service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:44.907376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3ab5-abf0-4b9c-9d5e-e2f28c96653d service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:44.907807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3ab5-abf0-4b9c-9d5e-e2f28c96653d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:44.916509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a3ab5-abf0-4b9c-9d5e-e2f28c96653d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:44.918859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a3ab5-abf0-4b9c-9d5e-e2f28c96653d service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:44.929397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 698/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:45.587501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2ff0-c522-4e57-a45b-79c17a8cc3bb None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:45.587880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2ff0-c522-4e57-a45b-79c17a8cc3bb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:45.588065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec2ff0-c522-4e57-a45b-79c17a8cc3bb None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:45.590104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 674/1372] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:45.595498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71faeb-e878-4e36-9885-38e1baa50d5f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:45.595863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71faeb-e878-4e36-9885-38e1baa50d5f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:45.596218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71faeb-e878-4e36-9885-38e1baa50d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:45.615871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ab71faeb-e878-4e36-9885-38e1baa50d5f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:45.617183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ab71faeb-e878-4e36-9885-38e1baa50d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:45.625429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 699/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:45.940610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979fc1c-4588-48f4-b7a9-e17932243f53 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:45.941066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979fc1c-4588-48f4-b7a9-e17932243f53 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:45.941149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979fc1c-4588-48f4-b7a9-e17932243f53 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:45.943041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 675/1374] 10.222.0.44 () {54 vars in 963 bytes} [Thu Jun 30 10:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:45.947851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733a61-dc37-4c17-9da5-0c8c302fdb5b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:45.949250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733a61-dc37-4c17-9da5-0c8c302fdb5b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:45.949594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733a61-dc37-4c17-9da5-0c8c302fdb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:45.973062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:14:46.001270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-37733a61-dc37-4c17-9da5-0c8c302fdb5b None None] MFA Rules not processed for user `b5eb306a63e14e57a10d468a4aa65db0`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:46.002471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-37733a61-dc37-4c17-9da5-0c8c302fdb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:46.066632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 700/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Thu Jun 30 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:46.075075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979fc1c-4588-48f4-b7a9-e17932243f53 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:46.087237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979fc1c-4588-48f4-b7a9-e17932243f53 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:46.090906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf5cb5-253b-4503-a3e5-4edb2c1bf458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:46.091623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5cb5-253b-4503-a3e5-4edb2c1bf458 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:46.091977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5cb5-253b-4503-a3e5-4edb2c1bf458 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:46.092323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5cb5-253b-4503-a3e5-4edb2c1bf458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:46.102266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf5cb5-253b-4503-a3e5-4edb2c1bf458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:46.104018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf5cb5-253b-4503-a3e5-4edb2c1bf458 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:46.114235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 676/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:46.997792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173049f1-97b4-442e-b9b9-5acfe575247c None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:46.998305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173049f1-97b4-442e-b9b9-5acfe575247c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:46.998411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173049f1-97b4-442e-b9b9-5acfe575247c None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:46.999756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 701/1377] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:47.004981 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77173c-fa15-452a-ac89-989c6495f200 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:47.005410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77173c-fa15-452a-ac89-989c6495f200 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:47.005685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77173c-fa15-452a-ac89-989c6495f200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:47.024211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5f77173c-fa15-452a-ac89-989c6495f200 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:47.025472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5f77173c-fa15-452a-ac89-989c6495f200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:47.035004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 677/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:47.079117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173049f1-97b4-442e-b9b9-5acfe575247c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:47.098080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173049f1-97b4-442e-b9b9-5acfe575247c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:47.104014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab63274-8be7-4901-bdad-685eef8e4c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:47.105278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63274-8be7-4901-bdad-685eef8e4c19 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:47.105598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63274-8be7-4901-bdad-685eef8e4c19 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:47.105884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63274-8be7-4901-bdad-685eef8e4c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:47.114535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab63274-8be7-4901-bdad-685eef8e4c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:47.116162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab63274-8be7-4901-bdad-685eef8e4c19 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:47.125659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 702/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:49.177001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51bbb2-3821-4c1f-8bed-47c373ad6c1d None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:49.177906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51bbb2-3821-4c1f-8bed-47c373ad6c1d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:49.178344 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51bbb2-3821-4c1f-8bed-47c373ad6c1d None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:49.179918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 678/1380] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:49.185967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b6b0a-2d7b-486c-9c8a-301028f05611 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:49.186426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b6b0a-2d7b-486c-9c8a-301028f05611 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:49.186528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b6b0a-2d7b-486c-9c8a-301028f05611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:49.205800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-805b6b0a-2d7b-486c-9c8a-301028f05611 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:49.206956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-805b6b0a-2d7b-486c-9c8a-301028f05611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:49.217961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 703/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:49.262570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51bbb2-3821-4c1f-8bed-47c373ad6c1d None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:49.276788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51bbb2-3821-4c1f-8bed-47c373ad6c1d None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:49.282234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a53c4f-8d14-4e24-91b1-7747b632f626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:49.282877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a53c4f-8d14-4e24-91b1-7747b632f626 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:49.283158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a53c4f-8d14-4e24-91b1-7747b632f626 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:49.283430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a53c4f-8d14-4e24-91b1-7747b632f626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:49.291954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a53c4f-8d14-4e24-91b1-7747b632f626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:49.293761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a53c4f-8d14-4e24-91b1-7747b632f626 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:49.304388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 679/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:51.379634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c4f5-2a5f-4d15-9b96-a15f3758cb07 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:51.380188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c4f5-2a5f-4d15-9b96-a15f3758cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:51.380188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3c4f5-2a5f-4d15-9b96-a15f3758cb07 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:51.381568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 704/1383] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:51.386670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8616769-43e5-45f5-ad2d-a2ec63e92079 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:51.387102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8616769-43e5-45f5-ad2d-a2ec63e92079 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:51.387265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8616769-43e5-45f5-ad2d-a2ec63e92079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:51.405685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f8616769-43e5-45f5-ad2d-a2ec63e92079 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:51.406901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f8616769-43e5-45f5-ad2d-a2ec63e92079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:51.414938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 680/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:51.456277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3c4f5-2a5f-4d15-9b96-a15f3758cb07 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:51.471514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3c4f5-2a5f-4d15-9b96-a15f3758cb07 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:51.479745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08397afd-5aab-4084-8d3c-1c0af1524b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:51.481298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08397afd-5aab-4084-8d3c-1c0af1524b44 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:51.481592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08397afd-5aab-4084-8d3c-1c0af1524b44 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:51.481871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08397afd-5aab-4084-8d3c-1c0af1524b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:51.491341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08397afd-5aab-4084-8d3c-1c0af1524b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:51.492931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08397afd-5aab-4084-8d3c-1c0af1524b44 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:51.507420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 705/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:53.535680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f6938-e556-4efa-8d4f-ab0f5469d6f7 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:53.536276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f6938-e556-4efa-8d4f-ab0f5469d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:53.536276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f6938-e556-4efa-8d4f-ab0f5469d6f7 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:53.538055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 681/1386] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:53.543446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50614e-f22e-49a8-9c52-03908c17ace6 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:53.543917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50614e-f22e-49a8-9c52-03908c17ace6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:53.543917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50614e-f22e-49a8-9c52-03908c17ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:53.581449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ef50614e-f22e-49a8-9c52-03908c17ace6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:53.582468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ef50614e-f22e-49a8-9c52-03908c17ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:53.596203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 706/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:53.640466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f6938-e556-4efa-8d4f-ab0f5469d6f7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:53.657160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f6938-e556-4efa-8d4f-ab0f5469d6f7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:53.665130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea7daa-9aab-4fc7-999f-eb44e41fd637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:53.666263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7daa-9aab-4fc7-999f-eb44e41fd637 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:53.667092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7daa-9aab-4fc7-999f-eb44e41fd637 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:53.667372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7daa-9aab-4fc7-999f-eb44e41fd637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:53.676639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea7daa-9aab-4fc7-999f-eb44e41fd637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:53.678305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea7daa-9aab-4fc7-999f-eb44e41fd637 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:53.688187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 682/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:14:55.794716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3500e-2827-4bc5-a6d9-ee485c96eb5a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:55.795559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3500e-2827-4bc5-a6d9-ee485c96eb5a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:55.795559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3500e-2827-4bc5-a6d9-ee485c96eb5a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:55.797001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 707/1389] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:55.802377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ae616-8691-425d-8d7b-3aac0e87ab3f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:55.803018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ae616-8691-425d-8d7b-3aac0e87ab3f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:55.803018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ae616-8691-425d-8d7b-3aac0e87ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:55.823239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b77ae616-8691-425d-8d7b-3aac0e87ab3f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:55.824631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b77ae616-8691-425d-8d7b-3aac0e87ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:55.832682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 683/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:14:55.880183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3500e-2827-4bc5-a6d9-ee485c96eb5a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:55.902075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3500e-2827-4bc5-a6d9-ee485c96eb5a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:55.909134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e44c3-b90f-4718-af18-6bff0a32abdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:55.909999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e44c3-b90f-4718-af18-6bff0a32abdd service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:55.910376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e44c3-b90f-4718-af18-6bff0a32abdd service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:55.910766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e44c3-b90f-4718-af18-6bff0a32abdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:55.924006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e44c3-b90f-4718-af18-6bff0a32abdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:55.925680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e44c3-b90f-4718-af18-6bff0a32abdd service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:55.937047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 708/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:14:58.073446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170eee-0048-430a-9e34-d62a9ae3cd0c None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:58.073987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170eee-0048-430a-9e34-d62a9ae3cd0c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:58.073987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24170eee-0048-430a-9e34-d62a9ae3cd0c None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:58.075384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 684/1392] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:14:58.080764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd37b40-e148-41c4-be28-4507582a6914 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:58.081519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd37b40-e148-41c4-be28-4507582a6914 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:58.081519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd37b40-e148-41c4-be28-4507582a6914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:58.099755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1cd37b40-e148-41c4-be28-4507582a6914 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:14:58.100994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1cd37b40-e148-41c4-be28-4507582a6914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:14:58.108805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 709/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:14:58.153359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170eee-0048-430a-9e34-d62a9ae3cd0c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:14:58.167703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24170eee-0048-430a-9e34-d62a9ae3cd0c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:14:58.173301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebb312-463e-4ece-9415-4d4ee5851e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:14:58.173976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb312-463e-4ece-9415-4d4ee5851e4f service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:14:58.174217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb312-463e-4ece-9415-4d4ee5851e4f service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:14:58.174488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebb312-463e-4ece-9415-4d4ee5851e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:14:58.183286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebb312-463e-4ece-9415-4d4ee5851e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:14:58.184874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebb312-463e-4ece-9415-4d4ee5851e4f service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:14:58.194731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 685/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:00.295558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71baf-6c68-45bf-9137-374154227e06 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:00.296171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71baf-6c68-45bf-9137-374154227e06 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:00.296452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d71baf-6c68-45bf-9137-374154227e06 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:00.297854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 710/1395] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:00.303296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1906-f607-4db6-b396-e76fa4b2c7be None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:00.303708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1906-f607-4db6-b396-e76fa4b2c7be None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:00.303985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1906-f607-4db6-b396-e76fa4b2c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:00.322486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1cdb1906-f607-4db6-b396-e76fa4b2c7be None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:00.323725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1cdb1906-f607-4db6-b396-e76fa4b2c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:00.331486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 686/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:00.376157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d71baf-6c68-45bf-9137-374154227e06 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:00.390531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d71baf-6c68-45bf-9137-374154227e06 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:00.396117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c76e29-5e38-4ac9-a126-67651fd5e5ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:00.396746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c76e29-5e38-4ac9-a126-67651fd5e5ab service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:00.397136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c76e29-5e38-4ac9-a126-67651fd5e5ab service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:00.397414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c76e29-5e38-4ac9-a126-67651fd5e5ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:00.406170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c76e29-5e38-4ac9-a126-67651fd5e5ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:00.407824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c76e29-5e38-4ac9-a126-67651fd5e5ab service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:00.417693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 711/1397] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:01.426282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106870a-0e26-47a1-8dc8-7a7535222f83 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:01.426878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106870a-0e26-47a1-8dc8-7a7535222f83 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:01.426878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106870a-0e26-47a1-8dc8-7a7535222f83 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:01.428256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 687/1398] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:01.433376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149d508-1845-4640-b938-11072f6627e1 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:01.433778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149d508-1845-4640-b938-11072f6627e1 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:01.433941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149d508-1845-4640-b938-11072f6627e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:01.452058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3149d508-1845-4640-b938-11072f6627e1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:01.453261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3149d508-1845-4640-b938-11072f6627e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:01.461012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 712/1399] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:01.516139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caa298-f746-45de-bf77-4fd85532a827 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:01.516428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caa298-f746-45de-bf77-4fd85532a827 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:01.516707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caa298-f746-45de-bf77-4fd85532a827 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:01.518067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 688/1400] 10.222.0.44 () {54 vars in 962 bytes} [Thu Jun 30 10:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:01.523169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30ebb-786f-450e-ad92-501b0483a739 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:01.523529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30ebb-786f-450e-ad92-501b0483a739 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:01.523896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff30ebb-786f-450e-ad92-501b0483a739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:01.575634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5ff30ebb-786f-450e-ad92-501b0483a739 None None] MFA Rules not processed for user `e40a1f11c5cd4b48be27dd1a0f48bdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:01.576824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5ff30ebb-786f-450e-ad92-501b0483a739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:01.617448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:15:01.636781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 713/1401] 10.222.0.44 () {58 vars in 1059 bytes} [Thu Jun 30 10:15:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:01.644372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caa298-f746-45de-bf77-4fd85532a827 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:01.655526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caa298-f746-45de-bf77-4fd85532a827 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:01.659046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f624bcc-aaa5-43c6-afcf-88ae588a9d09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40a1f11c5cd4b48be27dd1a0f48bdc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:01.659679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f624bcc-aaa5-43c6-afcf-88ae588a9d09 service glance] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:01.659963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f624bcc-aaa5-43c6-afcf-88ae588a9d09 service glance] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:01.660240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f624bcc-aaa5-43c6-afcf-88ae588a9d09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:01.669280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f624bcc-aaa5-43c6-afcf-88ae588a9d09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:01.670977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f624bcc-aaa5-43c6-afcf-88ae588a9d09 service glance] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:01.680307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 689/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:02.389411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dbcf8-4646-4a77-87e5-03747c3e4275 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:02.389779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dbcf8-4646-4a77-87e5-03747c3e4275 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:02.390127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dbcf8-4646-4a77-87e5-03747c3e4275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:02.438674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-272dbcf8-4646-4a77-87e5-03747c3e4275 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:02.440200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-272dbcf8-4646-4a77-87e5-03747c3e4275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:02.492082 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf1c2-fce8-4384-a6bd-6ccf88e9c104 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:02.492577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf1c2-fce8-4384-a6bd-6ccf88e9c104 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:02.492675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf1c2-fce8-4384-a6bd-6ccf88e9c104 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:02.494714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 690/1403] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:02.499412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8f7d-1335-411b-9e07-81da9d8686bc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:02.499696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8f7d-1335-411b-9e07-81da9d8686bc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:02.499966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8f7d-1335-411b-9e07-81da9d8686bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:02.503656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 714/1404] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:02.505937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=61 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:15:02.518982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8b5f8f7d-1335-411b-9e07-81da9d8686bc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:02.520194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8b5f8f7d-1335-411b-9e07-81da9d8686bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:02.528386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 691/1405] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:15:02.550476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826641c0-eaf4-4c4a-96e1-53b89dbed912 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:02.550805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826641c0-eaf4-4c4a-96e1-53b89dbed912 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:02.551084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826641c0-eaf4-4c4a-96e1-53b89dbed912 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:02.552470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 715/1406] 10.222.0.44 () {54 vars in 942 bytes} [Thu Jun 30 10:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:15:02.559311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d4cd-fb07-4841-84e3-771a5f888377 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:02.559607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d4cd-fb07-4841-84e3-771a5f888377 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:02.559885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591d4cd-fb07-4841-84e3-771a5f888377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:02.572986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826641c0-eaf4-4c4a-96e1-53b89dbed912 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:02.587085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826641c0-eaf4-4c4a-96e1-53b89dbed912 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:02.593808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:02.594436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:02.594775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:02.595061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:02.604197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:02.605781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:02.608350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5591d4cd-fb07-4841-84e3-771a5f888377 None None] MFA Rules not processed for user `56e635c1ca5341b2892f0c8846b280d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:02.609655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5591d4cd-fb07-4841-84e3-771a5f888377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:02.615761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 716/1407] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:02.689336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 692/1408] 10.222.0.44 () {58 vars in 1039 bytes} [Thu Jun 30 10:15:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:15:02.699405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:02.711544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0660-c2c2-4a25-ae27-e49518db6d3b service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:02.717378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6e341-ecd8-449e-9035-852bad8e8d77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:02.718037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6e341-ecd8-449e-9035-852bad8e8d77 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:02.718327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6e341-ecd8-449e-9035-852bad8e8d77 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:02.718607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6e341-ecd8-449e-9035-852bad8e8d77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:02.727866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6e341-ecd8-449e-9035-852bad8e8d77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:02.730058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6e341-ecd8-449e-9035-852bad8e8d77 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:02.739948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 717/1409] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:15:12.685733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=46 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:15:12.735652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=58 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:15:26.419604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06a8d-762f-4fd5-967f-00a373806b85 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:26.420158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06a8d-762f-4fd5-967f-00a373806b85 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:26.420158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06a8d-762f-4fd5-967f-00a373806b85 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:26.421599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 693/1410] 10.222.0.44 () {54 vars in 918 bytes} [Thu Jun 30 10:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:26.426867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701f453-36fc-45d2-be89-0dd62205a9fb None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:26.427301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701f453-36fc-45d2-be89-0dd62205a9fb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:26.427431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701f453-36fc-45d2-be89-0dd62205a9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:26.445936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8701f453-36fc-45d2-be89-0dd62205a9fb None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:26.447175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8701f453-36fc-45d2-be89-0dd62205a9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:26.455611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 718/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 30 10:15:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:26.469364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d64c-3914-4ed6-82bd-dc8bb1cd70f0 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:26.469654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d64c-3914-4ed6-82bd-dc8bb1cd70f0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:26.469934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3d64c-3914-4ed6-82bd-dc8bb1cd70f0 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:26.471294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 694/1412] 10.222.0.44 () {54 vars in 918 bytes} [Thu Jun 30 10:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:26.475807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8df6b8-8a9d-48a8-893b-7e9a8c9d3a08 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:26.476098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8df6b8-8a9d-48a8-893b-7e9a8c9d3a08 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:26.476376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8df6b8-8a9d-48a8-893b-7e9a8c9d3a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:26.495305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3d8df6b8-8a9d-48a8-893b-7e9a8c9d3a08 None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:26.496499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3d8df6b8-8a9d-48a8-893b-7e9a8c9d3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:26.505656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 719/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 30 10:15:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:15:29.034946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee5e0-20b4-4849-a791-748dace454ea None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:29.035545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee5e0-20b4-4849-a791-748dace454ea None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:29.035545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee5e0-20b4-4849-a791-748dace454ea None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:29.036924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:29.042330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcc6b-b8b7-4bf7-aaa7-4490b08ebc1c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:29.042800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcc6b-b8b7-4bf7-aaa7-4490b08ebc1c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:29.042921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcc6b-b8b7-4bf7-aaa7-4490b08ebc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:29.061805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-93dfcc6b-b8b7-4bf7-aaa7-4490b08ebc1c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:29.063043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-93dfcc6b-b8b7-4bf7-aaa7-4490b08ebc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:29.071770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:29.113907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee5e0-20b4-4849-a791-748dace454ea None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:29.128927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee5e0-20b4-4849-a791-748dace454ea None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:29.135040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e06473-b779-45f8-b2df-f599ec19a739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:29.135678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e06473-b779-45f8-b2df-f599ec19a739 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:29.135963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e06473-b779-45f8-b2df-f599ec19a739 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:29.136252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e06473-b779-45f8-b2df-f599ec19a739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:29.144520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e06473-b779-45f8-b2df-f599ec19a739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:29.146122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e06473-b779-45f8-b2df-f599ec19a739 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:29.155701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 696/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:30.054414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf2de-b349-4130-95e2-fd0166f77f01 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:30.055040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf2de-b349-4130-95e2-fd0166f77f01 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:30.055040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcf2de-b349-4130-95e2-fd0166f77f01 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:30.056394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:30.061530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf375d-232f-4a22-961d-e428760abc2d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:30.061990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf375d-232f-4a22-961d-e428760abc2d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:30.062097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf375d-232f-4a22-961d-e428760abc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:30.080775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-dcbf375d-232f-4a22-961d-e428760abc2d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:30.081975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dcbf375d-232f-4a22-961d-e428760abc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:30.090251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:15:30.237073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcf2de-b349-4130-95e2-fd0166f77f01 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:30.251056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcf2de-b349-4130-95e2-fd0166f77f01 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:30.256311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b09e3-d0f6-48ba-ad2b-e4a7ea5144f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:30.256943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b09e3-d0f6-48ba-ad2b-e4a7ea5144f0 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:30.257222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b09e3-d0f6-48ba-ad2b-e4a7ea5144f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:30.257494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b09e3-d0f6-48ba-ad2b-e4a7ea5144f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:30.266266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b09e3-d0f6-48ba-ad2b-e4a7ea5144f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:30.267861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b09e3-d0f6-48ba-ad2b-e4a7ea5144f0 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:30.277790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 722/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:31.167712 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9a31-8e07-4a28-bb47-ca51c6b5e32b None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:31.168261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9a31-8e07-4a28-bb47-ca51c6b5e32b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:31.168261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9a31-8e07-4a28-bb47-ca51c6b5e32b None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:31.169628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:31.174563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac932-1e72-488e-afed-5f124b35e99a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:31.175043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac932-1e72-488e-afed-5f124b35e99a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:31.175147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfac932-1e72-488e-afed-5f124b35e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:31.193375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2cfac932-1e72-488e-afed-5f124b35e99a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:31.194576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2cfac932-1e72-488e-afed-5f124b35e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:31.202421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:31.354434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9a31-8e07-4a28-bb47-ca51c6b5e32b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:31.368673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9a31-8e07-4a28-bb47-ca51c6b5e32b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:31.374105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3db523-ae63-4b6b-9377-190ca030bd92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:31.374768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db523-ae63-4b6b-9377-190ca030bd92 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:31.375057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db523-ae63-4b6b-9377-190ca030bd92 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:31.375335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db523-ae63-4b6b-9377-190ca030bd92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:31.383618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db523-ae63-4b6b-9377-190ca030bd92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:31.385217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db523-ae63-4b6b-9377-190ca030bd92 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:31.395366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 699/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:32.259769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca51a0-2485-4b6c-b5b3-9ba0f4c2a7ca None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:32.260316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca51a0-2485-4b6c-b5b3-9ba0f4c2a7ca None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:32.260316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca51a0-2485-4b6c-b5b3-9ba0f4c2a7ca None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:32.261716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:32.266759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23c14e-d9e7-45fa-a6d3-c4429e245806 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:32.267199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23c14e-d9e7-45fa-a6d3-c4429e245806 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:32.267354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23c14e-d9e7-45fa-a6d3-c4429e245806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:32.285460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1c23c14e-d9e7-45fa-a6d3-c4429e245806 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:32.286681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1c23c14e-d9e7-45fa-a6d3-c4429e245806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:32.295320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:32.447522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca51a0-2485-4b6c-b5b3-9ba0f4c2a7ca None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:32.462200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca51a0-2485-4b6c-b5b3-9ba0f4c2a7ca None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:32.467602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ff88a-e606-4859-9c73-e056c564acc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:32.468237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff88a-e606-4859-9c73-e056c564acc8 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:32.468519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff88a-e606-4859-9c73-e056c564acc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:32.468794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff88a-e606-4859-9c73-e056c564acc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:32.477168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ff88a-e606-4859-9c73-e056c564acc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:32.478787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ff88a-e606-4859-9c73-e056c564acc8 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:32.489196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 725/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:33.348271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8dac-be25-429b-8130-9b1b6cd36e25 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:33.348867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8dac-be25-429b-8130-9b1b6cd36e25 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:33.348867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a8dac-be25-429b-8130-9b1b6cd36e25 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:33.350175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:33.355139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ba8d-2b1a-4c58-b5f6-1b2fcd72ffbe None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:33.355600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ba8d-2b1a-4c58-b5f6-1b2fcd72ffbe None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:33.355705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7ba8d-2b1a-4c58-b5f6-1b2fcd72ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:33.374185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a0b7ba8d-2b1a-4c58-b5f6-1b2fcd72ffbe None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:33.375407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a0b7ba8d-2b1a-4c58-b5f6-1b2fcd72ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:33.383631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:33.536816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a8dac-be25-429b-8130-9b1b6cd36e25 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:33.555380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a8dac-be25-429b-8130-9b1b6cd36e25 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:33.561701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241ce27-dbc5-467d-b423-16356fb7c897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:33.562350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ce27-dbc5-467d-b423-16356fb7c897 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:33.562630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ce27-dbc5-467d-b423-16356fb7c897 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:33.562941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241ce27-dbc5-467d-b423-16356fb7c897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:33.571825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ce27-dbc5-467d-b423-16356fb7c897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:33.573422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241ce27-dbc5-467d-b423-16356fb7c897 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:33.583027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 702/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:34.404312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f9617-e4d1-4adc-9e68-7455b1597eee None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:34.404884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f9617-e4d1-4adc-9e68-7455b1597eee None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:34.405016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f9617-e4d1-4adc-9e68-7455b1597eee None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:34.406404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:34.411486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9291-6302-474c-87c4-ba99eccbd448 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:34.411901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9291-6302-474c-87c4-ba99eccbd448 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:34.412052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef9291-6302-474c-87c4-ba99eccbd448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:34.430312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6eef9291-6302-474c-87c4-ba99eccbd448 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:34.431568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6eef9291-6302-474c-87c4-ba99eccbd448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:34.439650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:34.588665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f9617-e4d1-4adc-9e68-7455b1597eee None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:34.605573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f9617-e4d1-4adc-9e68-7455b1597eee None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:34.610893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb2353-9631-4eb5-b8f0-feff4326cbff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:34.611558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2353-9631-4eb5-b8f0-feff4326cbff service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:34.611839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2353-9631-4eb5-b8f0-feff4326cbff service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:34.612113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb2353-9631-4eb5-b8f0-feff4326cbff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:34.620428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2353-9631-4eb5-b8f0-feff4326cbff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:34.622008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb2353-9631-4eb5-b8f0-feff4326cbff service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:34.631594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 728/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:35.443391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693287b3-ebe2-4f33-8925-91d96d757332 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:35.444066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693287b3-ebe2-4f33-8925-91d96d757332 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:35.444066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693287b3-ebe2-4f33-8925-91d96d757332 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:35.445339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:35.450285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466cd84-0ffa-4215-8047-3b5ec315fa28 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:35.450781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466cd84-0ffa-4215-8047-3b5ec315fa28 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:35.450901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466cd84-0ffa-4215-8047-3b5ec315fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:35.468465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8466cd84-0ffa-4215-8047-3b5ec315fa28 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:35.469661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8466cd84-0ffa-4215-8047-3b5ec315fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:35.477973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:15:35.638163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693287b3-ebe2-4f33-8925-91d96d757332 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:35.653108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693287b3-ebe2-4f33-8925-91d96d757332 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:35.658535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d9901-48d6-411e-82d2-3def0185e451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:35.659216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d9901-48d6-411e-82d2-3def0185e451 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:35.659502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d9901-48d6-411e-82d2-3def0185e451 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:35.659782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d9901-48d6-411e-82d2-3def0185e451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:35.669358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d9901-48d6-411e-82d2-3def0185e451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:35.671338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d9901-48d6-411e-82d2-3def0185e451 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:35.681638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 705/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:36.484067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2722304-a6d0-407d-883b-45011432b678 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:36.484671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2722304-a6d0-407d-883b-45011432b678 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:36.484671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2722304-a6d0-407d-883b-45011432b678 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:36.485998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:36.491132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4677276-ed5e-426d-ae11-064d0f278ad0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:36.492083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4677276-ed5e-426d-ae11-064d0f278ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:36.492230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4677276-ed5e-426d-ae11-064d0f278ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:36.510380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f4677276-ed5e-426d-ae11-064d0f278ad0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:36.511599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f4677276-ed5e-426d-ae11-064d0f278ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:36.519281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:36.670254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2722304-a6d0-407d-883b-45011432b678 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:36.685707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2722304-a6d0-407d-883b-45011432b678 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:36.691384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5464a-3d9f-4838-b0c0-07a6ab6617a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:36.692023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5464a-3d9f-4838-b0c0-07a6ab6617a2 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:36.692308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5464a-3d9f-4838-b0c0-07a6ab6617a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:36.692586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5464a-3d9f-4838-b0c0-07a6ab6617a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:36.701146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5464a-3d9f-4838-b0c0-07a6ab6617a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:36.702846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5464a-3d9f-4838-b0c0-07a6ab6617a2 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:36.712465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 731/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:37.535948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9157af-c822-4497-b08d-321297ba1f7b None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:37.536507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9157af-c822-4497-b08d-321297ba1f7b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:37.536507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9157af-c822-4497-b08d-321297ba1f7b None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:37.537889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:37.543203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ae25-eb65-4014-9219-5789455a4c05 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:37.543645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ae25-eb65-4014-9219-5789455a4c05 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:37.543745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91ae25-eb65-4014-9219-5789455a4c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:37.562377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-eb91ae25-eb65-4014-9219-5789455a4c05 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:37.563871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-eb91ae25-eb65-4014-9219-5789455a4c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:37.572152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:37.724946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9157af-c822-4497-b08d-321297ba1f7b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:37.739527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9157af-c822-4497-b08d-321297ba1f7b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:37.744863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9bee9-5dd1-476b-8b8a-f1e8f8349c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:37.745498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9bee9-5dd1-476b-8b8a-f1e8f8349c70 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:37.745781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9bee9-5dd1-476b-8b8a-f1e8f8349c70 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:37.746056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9bee9-5dd1-476b-8b8a-f1e8f8349c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:37.754511 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9bee9-5dd1-476b-8b8a-f1e8f8349c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:37.756144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9bee9-5dd1-476b-8b8a-f1e8f8349c70 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:37.766240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 708/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:39.725549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8a05-20df-4c95-9116-2143ec107264 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:39.726142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8a05-20df-4c95-9116-2143ec107264 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:39.726142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed8a05-20df-4c95-9116-2143ec107264 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:39.727545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:39.733442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a05c-9e67-4625-89dd-395b90af82f6 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:39.733895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a05c-9e67-4625-89dd-395b90af82f6 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:39.734006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a05c-9e67-4625-89dd-395b90af82f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:39.752334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-7f86a05c-9e67-4625-89dd-395b90af82f6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:39.753521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7f86a05c-9e67-4625-89dd-395b90af82f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:39.761834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:39.800333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed8a05-20df-4c95-9116-2143ec107264 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:39.811064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed8a05-20df-4c95-9116-2143ec107264 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:39.814891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5cb2-fab0-4a40-a06c-0d1ba7288d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:39.815556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5cb2-fab0-4a40-a06c-0d1ba7288d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:39.815842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5cb2-fab0-4a40-a06c-0d1ba7288d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:39.816121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5cb2-fab0-4a40-a06c-0d1ba7288d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:39.825813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5cb2-fab0-4a40-a06c-0d1ba7288d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:39.827291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5cb2-fab0-4a40-a06c-0d1ba7288d66 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:39.837494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 734/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:42.064287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6460-2501-4b26-8dbc-496d652c7875 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:42.064854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6460-2501-4b26-8dbc-496d652c7875 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:42.064854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6460-2501-4b26-8dbc-496d652c7875 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:42.066193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:42.072314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67263-0e41-40ae-9ec6-6858beb06b03 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:42.072754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67263-0e41-40ae-9ec6-6858beb06b03 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:42.072852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67263-0e41-40ae-9ec6-6858beb06b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:42.090761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-00c67263-0e41-40ae-9ec6-6858beb06b03 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:42.092419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-00c67263-0e41-40ae-9ec6-6858beb06b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:42.100508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:42.139332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf6460-2501-4b26-8dbc-496d652c7875 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:42.150474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf6460-2501-4b26-8dbc-496d652c7875 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:42.153950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cb8c3-a1d6-4782-be5c-4e47424e8e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:42.154583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cb8c3-a1d6-4782-be5c-4e47424e8e66 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:42.154897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cb8c3-a1d6-4782-be5c-4e47424e8e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:42.155173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cb8c3-a1d6-4782-be5c-4e47424e8e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:42.164387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cb8c3-a1d6-4782-be5c-4e47424e8e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:42.165872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cb8c3-a1d6-4782-be5c-4e47424e8e66 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:42.175531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 711/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:44.521986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6eb8d2-e26a-485c-a431-3b3610949e15 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:44.522906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6eb8d2-e26a-485c-a431-3b3610949e15 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:44.522906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6eb8d2-e26a-485c-a431-3b3610949e15 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:44.524026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:44.530425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eee58-c034-44ec-92c5-f9f4a3e6e004 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:44.531098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eee58-c034-44ec-92c5-f9f4a3e6e004 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:44.531098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5eee58-c034-44ec-92c5-f9f4a3e6e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:44.549445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3f5eee58-c034-44ec-92c5-f9f4a3e6e004 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:44.550872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3f5eee58-c034-44ec-92c5-f9f4a3e6e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:44.559486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:44.599575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6eb8d2-e26a-485c-a431-3b3610949e15 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:44.610710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6eb8d2-e26a-485c-a431-3b3610949e15 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:44.614137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cd100-f161-45b5-9d96-a279f3a416f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:44.614794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd100-f161-45b5-9d96-a279f3a416f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:44.615078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd100-f161-45b5-9d96-a279f3a416f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:44.615351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cd100-f161-45b5-9d96-a279f3a416f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:44.624349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cd100-f161-45b5-9d96-a279f3a416f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:44.625811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cd100-f161-45b5-9d96-a279f3a416f2 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:44.635816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 737/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:46.861573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3d29-9090-42b1-a469-b74368694627 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:46.862088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3d29-9090-42b1-a469-b74368694627 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:46.862088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3d29-9090-42b1-a469-b74368694627 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:46.863419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:46.868796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2dc99-11ec-4e27-a9a7-99426d58ba92 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:46.869239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2dc99-11ec-4e27-a9a7-99426d58ba92 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:46.869343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2dc99-11ec-4e27-a9a7-99426d58ba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:46.891441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b3e2dc99-11ec-4e27-a9a7-99426d58ba92 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:46.892688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b3e2dc99-11ec-4e27-a9a7-99426d58ba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:46.901390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:46.941040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3d29-9090-42b1-a469-b74368694627 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:46.951881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb3d29-9090-42b1-a469-b74368694627 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:46.955469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd2aaf-b224-4873-8883-2af277bb78f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:46.956106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd2aaf-b224-4873-8883-2af277bb78f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:46.956390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd2aaf-b224-4873-8883-2af277bb78f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:46.956664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd2aaf-b224-4873-8883-2af277bb78f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:46.966531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd2aaf-b224-4873-8883-2af277bb78f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:46.968312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd2aaf-b224-4873-8883-2af277bb78f8 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:46.978527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 714/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:49.162052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087bbb2-b140-4564-9a16-e4d8b464e73e None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:49.162614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087bbb2-b140-4564-9a16-e4d8b464e73e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:49.162614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087bbb2-b140-4564-9a16-e4d8b464e73e None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:49.164684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:49.170021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc92e-a0c8-4422-8688-b84c85e31fd4 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:49.170404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc92e-a0c8-4422-8688-b84c85e31fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:49.170576 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc92e-a0c8-4422-8688-b84c85e31fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:49.188728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1b7fc92e-a0c8-4422-8688-b84c85e31fd4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:49.189959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1b7fc92e-a0c8-4422-8688-b84c85e31fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:49.197831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:49.237759 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087bbb2-b140-4564-9a16-e4d8b464e73e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:49.248727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087bbb2-b140-4564-9a16-e4d8b464e73e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:49.252321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b77e3-3f17-4bfd-b723-40be64b78563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:49.252960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b77e3-3f17-4bfd-b723-40be64b78563 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:49.253247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b77e3-3f17-4bfd-b723-40be64b78563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:49.253525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b77e3-3f17-4bfd-b723-40be64b78563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:49.262894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b77e3-3f17-4bfd-b723-40be64b78563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:49.264328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b77e3-3f17-4bfd-b723-40be64b78563 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:49.274170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 740/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:51.387016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b04c38-f0aa-49e5-90ca-490062ee1242 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:51.387589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b04c38-f0aa-49e5-90ca-490062ee1242 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:51.387589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b04c38-f0aa-49e5-90ca-490062ee1242 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:51.388947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:51.394433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b30aa-9d3e-4958-b69f-9f2b8071c80a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:51.394924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b30aa-9d3e-4958-b69f-9f2b8071c80a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:51.395035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b30aa-9d3e-4958-b69f-9f2b8071c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:51.413533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a47b30aa-9d3e-4958-b69f-9f2b8071c80a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:51.414819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a47b30aa-9d3e-4958-b69f-9f2b8071c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:51.422653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:51.460823 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b04c38-f0aa-49e5-90ca-490062ee1242 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:51.471759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b04c38-f0aa-49e5-90ca-490062ee1242 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:51.476091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd0c24-f7c7-4fab-a042-cbdbccdb9fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:51.476734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0c24-f7c7-4fab-a042-cbdbccdb9fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:51.477017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0c24-f7c7-4fab-a042-cbdbccdb9fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:51.477297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd0c24-f7c7-4fab-a042-cbdbccdb9fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:51.486528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd0c24-f7c7-4fab-a042-cbdbccdb9fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:51.488022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd0c24-f7c7-4fab-a042-cbdbccdb9fc7 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:51.497935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 717/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:15:53.630492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310eb9-39bd-442e-9c62-3d39e65a8035 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:53.631056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310eb9-39bd-442e-9c62-3d39e65a8035 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:53.631175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310eb9-39bd-442e-9c62-3d39e65a8035 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:53.633125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:53.638413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde065-4a71-4a01-80bb-32aeadde56a1 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:53.638839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde065-4a71-4a01-80bb-32aeadde56a1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:53.638997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde065-4a71-4a01-80bb-32aeadde56a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:53.644955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=70 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:15:53.657837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6adde065-4a71-4a01-80bb-32aeadde56a1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:53.659075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6adde065-4a71-4a01-80bb-32aeadde56a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:53.666841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:53.708514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c310eb9-39bd-442e-9c62-3d39e65a8035 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:53.713851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=73 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:15:53.720237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c310eb9-39bd-442e-9c62-3d39e65a8035 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:53.723733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637facd4-9df9-4a3b-b55e-db2a2df6c851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:53.724365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637facd4-9df9-4a3b-b55e-db2a2df6c851 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:53.724650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637facd4-9df9-4a3b-b55e-db2a2df6c851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:53.724926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637facd4-9df9-4a3b-b55e-db2a2df6c851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:53.733859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637facd4-9df9-4a3b-b55e-db2a2df6c851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:53.735323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637facd4-9df9-4a3b-b55e-db2a2df6c851 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:53.745167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 743/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:55.971249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3f1f-f12d-44e6-8e34-58fe255c466a None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:55.971824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3f1f-f12d-44e6-8e34-58fe255c466a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:55.972135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3f1f-f12d-44e6-8e34-58fe255c466a None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:55.973902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:55.982524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aed905-262b-4286-97d9-86614416a427 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:55.984440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aed905-262b-4286-97d9-86614416a427 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:55.984440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aed905-262b-4286-97d9-86614416a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:56.005411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c3aed905-262b-4286-97d9-86614416a427 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:56.007494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c3aed905-262b-4286-97d9-86614416a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:56.020727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:56.067032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3f1f-f12d-44e6-8e34-58fe255c466a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:56.079897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3f1f-f12d-44e6-8e34-58fe255c466a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:56.084592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4046f-a434-4a13-96c4-1a0be92b93b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:56.085761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4046f-a434-4a13-96c4-1a0be92b93b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:56.086045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4046f-a434-4a13-96c4-1a0be92b93b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:56.086314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4046f-a434-4a13-96c4-1a0be92b93b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:56.098741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4046f-a434-4a13-96c4-1a0be92b93b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:56.100239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4046f-a434-4a13-96c4-1a0be92b93b9 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:56.112053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 720/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:15:58.312755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eeebf-08da-4d67-8e55-83b4b43928b4 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:58.313893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eeebf-08da-4d67-8e55-83b4b43928b4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:58.314056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eeebf-08da-4d67-8e55-83b4b43928b4 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:58.315616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:15:58.320896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0788d78-e885-4d91-9c10-39bd7ae53e0e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:58.321358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0788d78-e885-4d91-9c10-39bd7ae53e0e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:58.321456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0788d78-e885-4d91-9c10-39bd7ae53e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:58.339174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d0788d78-e885-4d91-9c10-39bd7ae53e0e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:15:58.340382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d0788d78-e885-4d91-9c10-39bd7ae53e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:15:58.348428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:15:58.385762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eeebf-08da-4d67-8e55-83b4b43928b4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:15:58.397108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eeebf-08da-4d67-8e55-83b4b43928b4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:15:58.402595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c321e5e-2b94-4749-afd4-e3dbb24ab269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:15:58.403265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321e5e-2b94-4749-afd4-e3dbb24ab269 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:15:58.403545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321e5e-2b94-4749-afd4-e3dbb24ab269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:15:58.403817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321e5e-2b94-4749-afd4-e3dbb24ab269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:15:58.413838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c321e5e-2b94-4749-afd4-e3dbb24ab269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:15:58.416100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c321e5e-2b94-4749-afd4-e3dbb24ab269 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:15:58.425988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 746/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:00.523532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4293d72-b101-4a3a-b684-f60a5b9e5037 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:00.524134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4293d72-b101-4a3a-b684-f60a5b9e5037 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:00.524134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4293d72-b101-4a3a-b684-f60a5b9e5037 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:00.525490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:00.530679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeaabd-29b3-4483-84fd-9fb1fef00ee3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:00.531132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeaabd-29b3-4483-84fd-9fb1fef00ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:00.531377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeaabd-29b3-4483-84fd-9fb1fef00ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:00.549930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5caeaabd-29b3-4483-84fd-9fb1fef00ee3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:00.551195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5caeaabd-29b3-4483-84fd-9fb1fef00ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:00.560072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:16:00.596899 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4293d72-b101-4a3a-b684-f60a5b9e5037 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:00.608404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4293d72-b101-4a3a-b684-f60a5b9e5037 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:00.612299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505087-95df-4a20-9c1b-647308f509a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:00.612949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505087-95df-4a20-9c1b-647308f509a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:00.613232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505087-95df-4a20-9c1b-647308f509a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:00.613505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505087-95df-4a20-9c1b-647308f509a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:00.624067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de505087-95df-4a20-9c1b-647308f509a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:00.625538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de505087-95df-4a20-9c1b-647308f509a8 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:00.635651 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 723/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:10.544630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=17 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:16:10.631291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=17 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:16:23.177543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd300f-0779-420f-b398-8de507c7d417 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:23.178146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd300f-0779-420f-b398-8de507c7d417 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:23.178146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd300f-0779-420f-b398-8de507c7d417 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:23.179563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 748/1471] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:23.185162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aca90-b033-4b0d-b224-f3b603bf081e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:23.185662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aca90-b033-4b0d-b224-f3b603bf081e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:23.185783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aca90-b033-4b0d-b224-f3b603bf081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:23.205596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1c0aca90-b033-4b0d-b224-f3b603bf081e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:23.206834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1c0aca90-b033-4b0d-b224-f3b603bf081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:23.215414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 724/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:16:23.265949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329de3d-82a1-4ba4-938c-35f0296ffa68 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:23.266243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329de3d-82a1-4ba4-938c-35f0296ffa68 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:23.266554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329de3d-82a1-4ba4-938c-35f0296ffa68 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:23.267982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 749/1473] 10.222.0.44 () {54 vars in 962 bytes} [Thu Jun 30 10:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:23.272952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba299878-2af9-438f-8c60-193e2f070ecd None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:23.273308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba299878-2af9-438f-8c60-193e2f070ecd None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:23.274163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba299878-2af9-438f-8c60-193e2f070ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:23.293504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ba299878-2af9-438f-8c60-193e2f070ecd None None] MFA Rules not processed for user `e40a1f11c5cd4b48be27dd1a0f48bdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:23.294709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ba299878-2af9-438f-8c60-193e2f070ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:23.303678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 725/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Thu Jun 30 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:16:23.316019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329de3d-82a1-4ba4-938c-35f0296ffa68 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:23.330403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329de3d-82a1-4ba4-938c-35f0296ffa68 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:23.335064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf77d79-8a03-4481-b8b8-a654675d6858 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40a1f11c5cd4b48be27dd1a0f48bdc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:23.335896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77d79-8a03-4481-b8b8-a654675d6858 service glance] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:23.336278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77d79-8a03-4481-b8b8-a654675d6858 service glance] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:23.336687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf77d79-8a03-4481-b8b8-a654675d6858 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:23.348438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77d79-8a03-4481-b8b8-a654675d6858 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:23.350424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf77d79-8a03-4481-b8b8-a654675d6858 service glance] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:23.363240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 750/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:25.638499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca126e3-dc2b-4b2b-84bb-025c3b55e8bf None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:25.639112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca126e3-dc2b-4b2b-84bb-025c3b55e8bf None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:25.639112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca126e3-dc2b-4b2b-84bb-025c3b55e8bf None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:25.640509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 726/1476] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:25.646491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e0eb-bb42-49f9-abb1-78468055a06f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:25.647002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e0eb-bb42-49f9-abb1-78468055a06f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:25.647131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e0eb-bb42-49f9-abb1-78468055a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:25.665098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f7d0e0eb-bb42-49f9-abb1-78468055a06f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:25.666296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f7d0e0eb-bb42-49f9-abb1-78468055a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:25.674509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 751/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:16:25.699358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca126e3-dc2b-4b2b-84bb-025c3b55e8bf None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:25.712226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca126e3-dc2b-4b2b-84bb-025c3b55e8bf None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:25.716940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e8b1b-e22a-4300-a5c3-2b0ae27b12b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:25.717971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e8b1b-e22a-4300-a5c3-2b0ae27b12b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:25.718239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e8b1b-e22a-4300-a5c3-2b0ae27b12b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:25.718571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e8b1b-e22a-4300-a5c3-2b0ae27b12b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:25.719193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e8b1b-e22a-4300-a5c3-2b0ae27b12b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:25.720996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-072e8b1b-e22a-4300-a5c3-2b0ae27b12b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:16:25.720996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:16:25.720996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:16:25.722125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e8b1b-e22a-4300-a5c3-2b0ae27b12b8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:25.742912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 727/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 30 10:16:25 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:16:27.897278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9651-1d84-4281-aaf4-e6a246d4de71 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:27.897849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9651-1d84-4281-aaf4-e6a246d4de71 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:27.897849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9651-1d84-4281-aaf4-e6a246d4de71 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:27.899869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 752/1479] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:27.905377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662da52-37c2-4f07-9e76-f6a40cb8f063 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:27.906115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662da52-37c2-4f07-9e76-f6a40cb8f063 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:27.906115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662da52-37c2-4f07-9e76-f6a40cb8f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:27.925052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0662da52-37c2-4f07-9e76-f6a40cb8f063 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:27.926313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0662da52-37c2-4f07-9e76-f6a40cb8f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:27.934208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 728/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:16:27.978963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9651-1d84-4281-aaf4-e6a246d4de71 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:27.994573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9651-1d84-4281-aaf4-e6a246d4de71 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:28.000039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35028c00-4b17-4790-8977-d705142206bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:28.000687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35028c00-4b17-4790-8977-d705142206bf service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:28.000974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35028c00-4b17-4790-8977-d705142206bf service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:28.001254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35028c00-4b17-4790-8977-d705142206bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:28.010088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35028c00-4b17-4790-8977-d705142206bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:28.011732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35028c00-4b17-4790-8977-d705142206bf service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:28.021926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 753/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:30.291803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6549e-2321-42c6-a4b1-ae8f4cf4b11b None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:30.292377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6549e-2321-42c6-a4b1-ae8f4cf4b11b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:30.292377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6549e-2321-42c6-a4b1-ae8f4cf4b11b None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:30.293780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 729/1482] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:30.299036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79041c0a-8347-4c4a-8e78-fd645505d88d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:30.299450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79041c0a-8347-4c4a-8e78-fd645505d88d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:30.299606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79041c0a-8347-4c4a-8e78-fd645505d88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:30.317946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-79041c0a-8347-4c4a-8e78-fd645505d88d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:30.319261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-79041c0a-8347-4c4a-8e78-fd645505d88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:30.327562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 754/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:16:30.364873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6549e-2321-42c6-a4b1-ae8f4cf4b11b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:30.378065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6549e-2321-42c6-a4b1-ae8f4cf4b11b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:30.382504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcffb6-c4ce-4d76-934a-17b28ff20e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:30.383205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcffb6-c4ce-4d76-934a-17b28ff20e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:30.383504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcffb6-c4ce-4d76-934a-17b28ff20e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:30.383763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcffb6-c4ce-4d76-934a-17b28ff20e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:30.393564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcffb6-c4ce-4d76-934a-17b28ff20e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:30.395064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcffb6-c4ce-4d76-934a-17b28ff20e02 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:30.405853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 730/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:32.544838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f5c5-068e-445b-ab91-b8c5ddec7a91 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:32.545445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f5c5-068e-445b-ab91-b8c5ddec7a91 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:32.545445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f5c5-068e-445b-ab91-b8c5ddec7a91 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:32.546793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 755/1485] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:32.552313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f66d-9efc-4842-bcb0-bae1e3168ad8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:32.552777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f66d-9efc-4842-bcb0-bae1e3168ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:32.552892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f66d-9efc-4842-bcb0-bae1e3168ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:32.572478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b499f66d-9efc-4842-bcb0-bae1e3168ad8 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:32.573700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b499f66d-9efc-4842-bcb0-bae1e3168ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:32.581903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 731/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:16:32.620749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6f5c5-068e-445b-ab91-b8c5ddec7a91 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:32.635413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6f5c5-068e-445b-ab91-b8c5ddec7a91 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:32.640533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a134-7940-4239-bc29-14260186882f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:32.641455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a134-7940-4239-bc29-14260186882f service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:32.641908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a134-7940-4239-bc29-14260186882f service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:32.642327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a134-7940-4239-bc29-14260186882f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:32.656863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250a134-7940-4239-bc29-14260186882f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:32.659212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250a134-7940-4239-bc29-14260186882f service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:32.674964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 756/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:34.918318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0047f-b997-4180-bab0-1ecddcc6648c None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:34.919065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0047f-b997-4180-bab0-1ecddcc6648c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:34.919065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0047f-b997-4180-bab0-1ecddcc6648c None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:34.920571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 732/1488] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:34.926616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85d1d-b28d-4675-9241-21bbd7d84e0e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:34.927101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85d1d-b28d-4675-9241-21bbd7d84e0e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:34.927269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85d1d-b28d-4675-9241-21bbd7d84e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:34.950391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a1e85d1d-b28d-4675-9241-21bbd7d84e0e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:34.951635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a1e85d1d-b28d-4675-9241-21bbd7d84e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:34.960706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 757/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:16:35.004904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0047f-b997-4180-bab0-1ecddcc6648c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:35.016188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0047f-b997-4180-bab0-1ecddcc6648c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:35.019895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17dfe0-c92c-4e76-876e-f217329b00d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:35.020550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17dfe0-c92c-4e76-876e-f217329b00d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:35.020834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17dfe0-c92c-4e76-876e-f217329b00d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:35.021112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17dfe0-c92c-4e76-876e-f217329b00d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:35.030762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17dfe0-c92c-4e76-876e-f217329b00d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:35.032226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17dfe0-c92c-4e76-876e-f217329b00d6 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:35.042361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 733/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:37.355086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a653df-57f1-44c0-beb5-a06cb4be92b8 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:37.355736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a653df-57f1-44c0-beb5-a06cb4be92b8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:37.355736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a653df-57f1-44c0-beb5-a06cb4be92b8 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:37.357026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 758/1491] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 30 10:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:16:37.362336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50c93-e679-4e4a-acd6-1d601726204e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:37.362813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50c93-e679-4e4a-acd6-1d601726204e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:37.362933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50c93-e679-4e4a-acd6-1d601726204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:37.380236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-85a50c93-e679-4e4a-acd6-1d601726204e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:16:37.381411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-85a50c93-e679-4e4a-acd6-1d601726204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:16:37.389746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 734/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 30 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:16:37.431166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a653df-57f1-44c0-beb5-a06cb4be92b8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:16:37.442014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a653df-57f1-44c0-beb5-a06cb4be92b8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:16:37.445556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ea9c2-eefc-434e-ba15-a577c8c5c105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:16:37.446185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea9c2-eefc-434e-ba15-a577c8c5c105 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:16:37.446486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea9c2-eefc-434e-ba15-a577c8c5c105 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:16:37.446774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea9c2-eefc-434e-ba15-a577c8c5c105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:16:37.455686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ea9c2-eefc-434e-ba15-a577c8c5c105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:16:37.457114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ea9c2-eefc-434e-ba15-a577c8c5c105 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:16:37.466582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 759/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:16:47.375305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=33 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:16:47.462392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=33 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:18:06.207913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0c02-a375-423a-9d3f-3e18c4749061 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.208532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0c02-a375-423a-9d3f-3e18c4749061 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.208532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0c02-a375-423a-9d3f-3e18c4749061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.226290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-54cc0c02-a375-423a-9d3f-3e18c4749061 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:18:06.227529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-54cc0c02-a375-423a-9d3f-3e18c4749061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:18:06.235330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 735/1494] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:18:06.243512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9174bb-f23e-4c94-811e-ee714af49701 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.244500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9174bb-f23e-4c94-811e-ee714af49701 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.244596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9174bb-f23e-4c94-811e-ee714af49701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.262948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-dc9174bb-f23e-4c94-811e-ee714af49701 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:18:06.264153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-dc9174bb-f23e-4c94-811e-ee714af49701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:18:06.272040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 760/1495] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:18:06.276784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0c02-a375-423a-9d3f-3e18c4749061 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.286798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0c02-a375-423a-9d3f-3e18c4749061 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.291323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.291971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.292253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.292524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.293242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:18:06.293546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.294570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:06.294570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:18:06.294570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:18:06.295484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:06.307638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 736/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:18:06.316186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9174bb-f23e-4c94-811e-ee714af49701 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.326378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9174bb-f23e-4c94-811e-ee714af49701 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.330983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.331641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.331925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.332203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.332899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.334718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING py.warnings [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:06.334718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: warnings.warn(msg) Jun 30 10:18:06.334718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: Jun 30 10:18:06.335918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:06.374695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 761/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:18:06 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:18:06.379063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.389736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0cf3c-d67e-48b6-8cdf-56857ae5e0ea admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.447159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.447828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.448111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.448386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.449071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.450092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:06.450092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:18:06.450092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:18:06.451349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:06.471785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 737/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:18:06 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:18:06.475824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.486808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9397bb-660d-486c-a3b7-20c0d6c24441 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.491576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.492248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.492536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.492816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.493552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.495204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING py.warnings [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:06.495204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: warnings.warn(msg) Jun 30 10:18:06.495204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: Jun 30 10:18:06.496089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:06.509211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 762/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:18:06.513689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.523847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609cfd-1e45-487a-82d9-c8e3230ee82c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.528569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7a953-db5e-482f-863d-bf64f846f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.529228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7a953-db5e-482f-863d-bf64f846f845 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.529509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7a953-db5e-482f-863d-bf64f846f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.529783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7a953-db5e-482f-863d-bf64f846f845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.530506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7a953-db5e-482f-863d-bf64f846f845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.531571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-61f7a953-db5e-482f-863d-bf64f846f845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:06.531571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:18:06.531571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:18:06.532470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7a953-db5e-482f-863d-bf64f846f845 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:06.546386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 738/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:18:06.550623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.561276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3d064-d725-4eac-9534-add36eb864bf admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.565941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37518ce-92e6-4792-8618-4fa1fe65023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.566867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37518ce-92e6-4792-8618-4fa1fe65023c admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.567153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37518ce-92e6-4792-8618-4fa1fe65023c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.567429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37518ce-92e6-4792-8618-4fa1fe65023c admin admin] PATH_INFO: `/v3/projects/288764b0fe744a189341dbed9f8355dd/users/22d2a3def7ef4b4ab1cb342bd4de1163/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.582476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37518ce-92e6-4792-8618-4fa1fe65023c admin admin] RBAC: Authorizing `identity:create_grant(project_id=288764b0fe744a189341dbed9f8355dd, user_id=22d2a3def7ef4b4ab1cb342bd4de1163, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.583555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING py.warnings [None req-c37518ce-92e6-4792-8618-4fa1fe65023c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:06.583555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: warnings.warn(msg) Jun 30 10:18:06.583555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: Jun 30 10:18:06.585482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37518ce-92e6-4792-8618-4fa1fe65023c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:06.598746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 763/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:18:06 2022] PUT /identity/v3/projects/288764b0fe744a189341dbed9f8355dd/users/22d2a3def7ef4b4ab1cb342bd4de1163/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:18:06.611812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c0e15-9f6b-4ac5-8bc1-3984c125e603 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.612107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c0e15-9f6b-4ac5-8bc1-3984c125e603 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.612385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c0e15-9f6b-4ac5-8bc1-3984c125e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.638746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-bd8c0e15-9f6b-4ac5-8bc1-3984c125e603 None None] MFA Rules not processed for user `22d2a3def7ef4b4ab1cb342bd4de1163`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:18:06.639977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-bd8c0e15-9f6b-4ac5-8bc1-3984c125e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:18:06.704002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 739/1502] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:18:06.717015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff558-ef37-4919-a14c-bb75c33b8e1a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.717313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff558-ef37-4919-a14c-bb75c33b8e1a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.717598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ff558-ef37-4919-a14c-bb75c33b8e1a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.719055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 764/1503] 10.222.0.44 () {54 vars in 963 bytes} [Thu Jun 30 10:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:18:06.723881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb784-1797-4848-96f8-b540e9a3c672 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.724107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb784-1797-4848-96f8-b540e9a3c672 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.724386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bb784-1797-4848-96f8-b540e9a3c672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.744547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c55bb784-1797-4848-96f8-b540e9a3c672 None None] MFA Rules not processed for user `b5eb306a63e14e57a10d468a4aa65db0`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:18:06.745748 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c55bb784-1797-4848-96f8-b540e9a3c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:18:06.789997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:18:06.799145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 740/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Thu Jun 30 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:18:06.807359 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff558-ef37-4919-a14c-bb75c33b8e1a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.818112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ff558-ef37-4919-a14c-bb75c33b8e1a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.821953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.822602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.822918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.823199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.831565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.833000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:06.842417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 765/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:18:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:18:06.885167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17597-817c-41ba-8ddc-28e1a561bd43 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.885458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17597-817c-41ba-8ddc-28e1a561bd43 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.885736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17597-817c-41ba-8ddc-28e1a561bd43 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.887231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 741/1506] 10.222.0.44 () {52 vars in 829 bytes} [Thu Jun 30 10:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:18:06.891019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:06.957168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe182b-a369-4b89-9386-2872c066b066 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:06.961760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:06.963183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:06.963460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:06.963745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] PATH_INFO: `/v3/users/22d2a3def7ef4b4ab1cb342bd4de1163` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:06.964947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d2a3def7ef4b4ab1cb342bd4de1163)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:06.965975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING py.warnings [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:06.965975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: warnings.warn(msg) Jun 30 10:18:06.965975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: Jun 30 10:18:06.967204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:07.031256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d2a3def7ef4b4ab1cb342bd4de1163'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.050194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d2a3def7ef4b4ab1cb342bd4de1163'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.050950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d2a3def7ef4b4ab1cb342bd4de1163'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.051667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d2a3def7ef4b4ab1cb342bd4de1163'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.066044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d2a3def7ef4b4ab1cb342bd4de1163'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.070931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:18:07.085209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 766/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:18:06 2022] DELETE /identity/v3/users/22d2a3def7ef4b4ab1cb342bd4de1163 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:18:07.090243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:07.090531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:07.090930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:07.110270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:18:07.111563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:18:07.175747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 742/1508] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:18:07.185891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:07.187465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:18:07.247136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac7cbd-1ea5-4458-aeb4-f6b02cf09104 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:07.250795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14563447-0c35-4a8e-af23-a7182c35a27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:07.251451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14563447-0c35-4a8e-af23-a7182c35a27a service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:07.251740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14563447-0c35-4a8e-af23-a7182c35a27a service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:07.252024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14563447-0c35-4a8e-af23-a7182c35a27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:07.262292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14563447-0c35-4a8e-af23-a7182c35a27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:07.263779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14563447-0c35-4a8e-af23-a7182c35a27a service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:07.273343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 767/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:18:07.687830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:18:07.689288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:18:07.701938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964eeed-07d0-4a20-ad31-b1bbb643ae2d None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:18:07.707687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:18:07.708565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:18:07.709090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:18:07.709303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] PATH_INFO: `/v3/projects/288764b0fe744a189341dbed9f8355dd` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:18:07.710556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=288764b0fe744a189341dbed9f8355dd)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:18:07.711680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:18:07.711680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:18:07.711680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:18:07.713418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:18:07.782222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288764b0fe744a189341dbed9f8355dd', 'request_id': 'req-32cd48df-c5ab-473d-9b14-7093b919d60c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.795527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288764b0fe744a189341dbed9f8355dd', 'request_id': 'req-32cd48df-c5ab-473d-9b14-7093b919d60c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.810972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288764b0fe744a189341dbed9f8355dd', 'request_id': 'req-32cd48df-c5ab-473d-9b14-7093b919d60c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.822655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] The token cache is being invalidate because project 288764b0fe744a189341dbed9f8355dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:18:07.822970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.823642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-32cd48df-c5ab-473d-9b14-7093b919d60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:18:07.825308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 743/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:18:07 2022] DELETE /identity/v3/projects/288764b0fe744a189341dbed9f8355dd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:18:17.269092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:18:17.819103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:19:49.796746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d723-ad31-49bc-b056-8a1fed5c58cc None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:49.797368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d723-ad31-49bc-b056-8a1fed5c58cc None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:49.797368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d723-ad31-49bc-b056-8a1fed5c58cc None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:49.798871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:19:49.804220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea0213-132a-4c4d-8693-18ca33dd25de None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:49.804746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea0213-132a-4c4d-8693-18ca33dd25de None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:49.804746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea0213-132a-4c4d-8693-18ca33dd25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:49.825536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-04ea0213-132a-4c4d-8693-18ca33dd25de None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:19:49.827301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-04ea0213-132a-4c4d-8693-18ca33dd25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:19:49.918068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:19:50.079903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125d723-ad31-49bc-b056-8a1fed5c58cc None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:19:50.081602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9125d723-ad31-49bc-b056-8a1fed5c58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:19:50.157425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125d723-ad31-49bc-b056-8a1fed5c58cc None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:19:50.162869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51025-269e-444c-82f5-60b70e29a73b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:19:50.163517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51025-269e-444c-82f5-60b70e29a73b service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:50.163798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51025-269e-444c-82f5-60b70e29a73b service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:50.164072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51025-269e-444c-82f5-60b70e29a73b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:50.173048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51025-269e-444c-82f5-60b70e29a73b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:19:50.174646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51025-269e-444c-82f5-60b70e29a73b service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:19:50.185852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 769/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:19:51.088424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38996-81ad-497b-ba43-8a9e605f7a25 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:51.089014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38996-81ad-497b-ba43-8a9e605f7a25 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:51.089014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38996-81ad-497b-ba43-8a9e605f7a25 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:51.090272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:19:51.095925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c22b2-111d-4157-93c9-dda32dbb5b7a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:51.096416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c22b2-111d-4157-93c9-dda32dbb5b7a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:51.096547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c22b2-111d-4157-93c9-dda32dbb5b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:51.117031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-825c22b2-111d-4157-93c9-dda32dbb5b7a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:19:51.118253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-825c22b2-111d-4157-93c9-dda32dbb5b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:19:51.126559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:19:51.282077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38996-81ad-497b-ba43-8a9e605f7a25 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:19:51.297740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38996-81ad-497b-ba43-8a9e605f7a25 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:19:51.303663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6e8c-d1fe-42a3-83ee-67368a1cc7c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:19:51.304320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6e8c-d1fe-42a3-83ee-67368a1cc7c9 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:51.304614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6e8c-d1fe-42a3-83ee-67368a1cc7c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:51.304896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6e8c-d1fe-42a3-83ee-67368a1cc7c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:51.314196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6e8c-d1fe-42a3-83ee-67368a1cc7c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:19:51.315626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6e8c-d1fe-42a3-83ee-67368a1cc7c9 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:19:51.327326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 746/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:19:51.960262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f189e-daae-47e8-8215-5eba53acd9a3 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:51.960577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f189e-daae-47e8-8215-5eba53acd9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:51.960819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f189e-daae-47e8-8215-5eba53acd9a3 None None] PATH_INFO: `/v3` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:51.962171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 771/1517] 10.222.0.55 () {54 vars in 925 bytes} [Thu Jun 30 10:19:51 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:19:51.990594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80302-ddf5-42bb-b2d2-ade32e06353f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:51.990973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80302-ddf5-42bb-b2d2-ade32e06353f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:51.991202 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a80302-ddf5-42bb-b2d2-ade32e06353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:52.012613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-64a80302-ddf5-42bb-b2d2-ade32e06353f None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:19:52.013856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-64a80302-ddf5-42bb-b2d2-ade32e06353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:19:52.084934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 747/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Jun 30 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:19:55.965122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3d5e0-bbe6-4d5b-8a86-a4137f38f0ee None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:55.965713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3d5e0-bbe6-4d5b-8a86-a4137f38f0ee None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:55.965713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3d5e0-bbe6-4d5b-8a86-a4137f38f0ee None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:55.967134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 772/1519] 10.222.0.44 () {54 vars in 960 bytes} [Thu Jun 30 10:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:19:55.972450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ad6fd-f27b-4415-b14e-4575fb5fce24 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:55.972945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ad6fd-f27b-4415-b14e-4575fb5fce24 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:55.973049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ad6fd-f27b-4415-b14e-4575fb5fce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:55.991529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d01ad6fd-f27b-4415-b14e-4575fb5fce24 None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:19:55.992727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d01ad6fd-f27b-4415-b14e-4575fb5fce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:19:56.001744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 748/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Thu Jun 30 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:19:56.009296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3d5e0-bbe6-4d5b-8a86-a4137f38f0ee None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:19:56.022866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3d5e0-bbe6-4d5b-8a86-a4137f38f0ee None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:19:56.027722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff95c8-8df9-4c1e-b555-f6b00a1ecdc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:19:56.028357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff95c8-8df9-4c1e-b555-f6b00a1ecdc1 service placement] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:19:56.028638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff95c8-8df9-4c1e-b555-f6b00a1ecdc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:19:56.028912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff95c8-8df9-4c1e-b555-f6b00a1ecdc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:19:56.037437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff95c8-8df9-4c1e-b555-f6b00a1ecdc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:19:56.039052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff95c8-8df9-4c1e-b555-f6b00a1ecdc1 service placement] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:19:56.049280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 773/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:19:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:20:02.595365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f7cb2-61cf-4753-9187-2f0e6c1a3146 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:02.596258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f7cb2-61cf-4753-9187-2f0e6c1a3146 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:02.596258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f7cb2-61cf-4753-9187-2f0e6c1a3146 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:02.597408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:20:02.603308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b8022-48aa-41eb-8acf-b5ab59b605ba None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:02.603862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b8022-48aa-41eb-8acf-b5ab59b605ba None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:02.604123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b8022-48aa-41eb-8acf-b5ab59b605ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:02.625295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5d5b8022-48aa-41eb-8acf-b5ab59b605ba None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:20:02.626528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5d5b8022-48aa-41eb-8acf-b5ab59b605ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:02.638181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:20:02.817871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f7cb2-61cf-4753-9187-2f0e6c1a3146 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:20:02.834057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f7cb2-61cf-4753-9187-2f0e6c1a3146 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:20:02.839840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07aee9-ccf6-4aee-a960-8356c62b7d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:20:02.840538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07aee9-ccf6-4aee-a960-8356c62b7d61 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:02.840821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07aee9-ccf6-4aee-a960-8356c62b7d61 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:02.841136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07aee9-ccf6-4aee-a960-8356c62b7d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:02.851567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07aee9-ccf6-4aee-a960-8356c62b7d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:20:02.853353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07aee9-ccf6-4aee-a960-8356c62b7d61 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:20:02.864468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 750/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:20:03.716949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0a6a-eb1c-4a6b-a4e4-236abf7c5bd4 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:03.717641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0a6a-eb1c-4a6b-a4e4-236abf7c5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:03.717641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0a6a-eb1c-4a6b-a4e4-236abf7c5bd4 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:03.718981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 10:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:20:03.724399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9895a50-fc18-4861-ba9e-b72d670dedb3 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:03.725199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9895a50-fc18-4861-ba9e-b72d670dedb3 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:03.725347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9895a50-fc18-4861-ba9e-b72d670dedb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:03.745789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a9895a50-fc18-4861-ba9e-b72d670dedb3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:20:03.746969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a9895a50-fc18-4861-ba9e-b72d670dedb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:03.755931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:20:03.912108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0a6a-eb1c-4a6b-a4e4-236abf7c5bd4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:20:03.927196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0a6a-eb1c-4a6b-a4e4-236abf7c5bd4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:20:03.932594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985e630-f0a7-4be2-8ef9-9c9f4f9d1367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:20:03.933239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e630-f0a7-4be2-8ef9-9c9f4f9d1367 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:03.933520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e630-f0a7-4be2-8ef9-9c9f4f9d1367 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:03.933794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985e630-f0a7-4be2-8ef9-9c9f4f9d1367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:03.942902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985e630-f0a7-4be2-8ef9-9c9f4f9d1367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:20:03.944511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985e630-f0a7-4be2-8ef9-9c9f4f9d1367 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:20:03.954986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 776/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:20:08.038851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33d78a-d65f-4703-a39c-d7179ee40a90 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:08.039596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33d78a-d65f-4703-a39c-d7179ee40a90 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:08.039904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33d78a-d65f-4703-a39c-d7179ee40a90 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:08.041566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:20:08.047698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb801e5e-c88a-42ba-bdd5-1aa4e87bce62 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:08.048247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb801e5e-c88a-42ba-bdd5-1aa4e87bce62 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:08.048247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb801e5e-c88a-42ba-bdd5-1aa4e87bce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:08.067091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-fb801e5e-c88a-42ba-bdd5-1aa4e87bce62 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:20:08.068323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-fb801e5e-c88a-42ba-bdd5-1aa4e87bce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:08.077454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:20:08.115600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33d78a-d65f-4703-a39c-d7179ee40a90 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:20:08.117346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7b33d78a-d65f-4703-a39c-d7179ee40a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:08.177325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33d78a-d65f-4703-a39c-d7179ee40a90 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:20:08.180980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860bd48-2356-414f-a835-07dc9cebc6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:20:08.181633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860bd48-2356-414f-a835-07dc9cebc6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:08.181916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860bd48-2356-414f-a835-07dc9cebc6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:08.182193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860bd48-2356-414f-a835-07dc9cebc6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:08.192264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860bd48-2356-414f-a835-07dc9cebc6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:20:08.193715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860bd48-2356-414f-a835-07dc9cebc6b2 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:20:08.199083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:20:08.210850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 753/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:20:10.277090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d640-3801-4879-8c5a-edbb60822584 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:10.277686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d640-3801-4879-8c5a-edbb60822584 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:10.277686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d640-3801-4879-8c5a-edbb60822584 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:10.279762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:20:10.285344 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6de22-a53a-4c7c-91d9-b45f0f4e5862 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:10.285849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6de22-a53a-4c7c-91d9-b45f0f4e5862 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:10.285974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6de22-a53a-4c7c-91d9-b45f0f4e5862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:10.304202 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3fe6de22-a53a-4c7c-91d9-b45f0f4e5862 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:20:10.305431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3fe6de22-a53a-4c7c-91d9-b45f0f4e5862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:10.313243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:20:10.355458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d640-3801-4879-8c5a-edbb60822584 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:20:10.366902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d640-3801-4879-8c5a-edbb60822584 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:20:10.370640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be2512-c642-4e0a-8c45-64fc55509d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:20:10.371312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be2512-c642-4e0a-8c45-64fc55509d73 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:10.371598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be2512-c642-4e0a-8c45-64fc55509d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:10.371874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be2512-c642-4e0a-8c45-64fc55509d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:10.381288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be2512-c642-4e0a-8c45-64fc55509d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:20:10.382757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be2512-c642-4e0a-8c45-64fc55509d73 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:20:10.393830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 779/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:20:14.065376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d719f3-2d5f-4bc2-8880-ceb0471aaa30 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:14.065955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d719f3-2d5f-4bc2-8880-ceb0471aaa30 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:14.065955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d719f3-2d5f-4bc2-8880-ceb0471aaa30 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:14.067343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:20:14.073461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816babed-7d1e-4a2c-aadb-3e476dcb11ba None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:14.073941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816babed-7d1e-4a2c-aadb-3e476dcb11ba None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:14.074130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816babed-7d1e-4a2c-aadb-3e476dcb11ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:14.093027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-816babed-7d1e-4a2c-aadb-3e476dcb11ba None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:20:14.094260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-816babed-7d1e-4a2c-aadb-3e476dcb11ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:14.102468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:20:14.419230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d719f3-2d5f-4bc2-8880-ceb0471aaa30 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:20:14.421670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-11d719f3-2d5f-4bc2-8880-ceb0471aaa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:14.496195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d719f3-2d5f-4bc2-8880-ceb0471aaa30 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:20:14.500032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0aff6-3ed1-44b5-96d0-23168341a42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:20:14.500691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0aff6-3ed1-44b5-96d0-23168341a42f service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:14.500977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0aff6-3ed1-44b5-96d0-23168341a42f service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:14.501258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0aff6-3ed1-44b5-96d0-23168341a42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:14.511103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0aff6-3ed1-44b5-96d0-23168341a42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:20:14.512571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0aff6-3ed1-44b5-96d0-23168341a42f service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:20:14.523361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 756/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:20:16.694969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f856c-f589-4d18-8f9d-e7bbda642a5a None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:16.695509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f856c-f589-4d18-8f9d-e7bbda642a5a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:16.695509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f856c-f589-4d18-8f9d-e7bbda642a5a None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:16.696962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 10:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:20:16.703940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879253d2-03ed-4068-b2b3-0e4147b1ba50 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:16.704535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879253d2-03ed-4068-b2b3-0e4147b1ba50 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:16.704535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879253d2-03ed-4068-b2b3-0e4147b1ba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:16.724038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-879253d2-03ed-4068-b2b3-0e4147b1ba50 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:20:16.725280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-879253d2-03ed-4068-b2b3-0e4147b1ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:16.733611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:20:17.050470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f856c-f589-4d18-8f9d-e7bbda642a5a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:20:17.052214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-791f856c-f589-4d18-8f9d-e7bbda642a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:20:17.066773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f856c-f589-4d18-8f9d-e7bbda642a5a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:20:17.070432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc726b62-eb9c-46cf-8fbe-3e376f4dd539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:20:17.071140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726b62-eb9c-46cf-8fbe-3e376f4dd539 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:20:17.071419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726b62-eb9c-46cf-8fbe-3e376f4dd539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:20:17.071689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc726b62-eb9c-46cf-8fbe-3e376f4dd539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:20:17.081702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc726b62-eb9c-46cf-8fbe-3e376f4dd539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:20:17.084203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc726b62-eb9c-46cf-8fbe-3e376f4dd539 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:20:17.093961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 782/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:20:26.718027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=32 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:20:27.089061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=70 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:51.360978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a719-daed-41b1-97e0-0ed1dcd70e5b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.362579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a719-daed-41b1-97e0-0ed1dcd70e5b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.363318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184a719-daed-41b1-97e0-0ed1dcd70e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.399950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c184a719-daed-41b1-97e0-0ed1dcd70e5b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.401372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c184a719-daed-41b1-97e0-0ed1dcd70e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.413352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 758/1540] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:21:51.423623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1123ae-f226-485c-9457-cb4576aeaef8 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.424221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1123ae-f226-485c-9457-cb4576aeaef8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.424221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1123ae-f226-485c-9457-cb4576aeaef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.451503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-cd1123ae-f226-485c-9457-cb4576aeaef8 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.453174 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cd1123ae-f226-485c-9457-cb4576aeaef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.470340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 783/1541] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.477387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a719-daed-41b1-97e0-0ed1dcd70e5b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:51.494086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184a719-daed-41b1-97e0-0ed1dcd70e5b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:51.503610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48b3f-f166-47ce-8068-029843468a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:51.504305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48b3f-f166-47ce-8068-029843468a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.504588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48b3f-f166-47ce-8068-029843468a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.504864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48b3f-f166-47ce-8068-029843468a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.505608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48b3f-f166-47ce-8068-029843468a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:51.505918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48b3f-f166-47ce-8068-029843468a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:51.507596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48b3f-f166-47ce-8068-029843468a2b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:51.531772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 759/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:51.540236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1123ae-f226-485c-9457-cb4576aeaef8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:51.547798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9eed1-d957-451c-b9de-236012b795a2 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.548147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9eed1-d957-451c-b9de-236012b795a2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.548363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9eed1-d957-451c-b9de-236012b795a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.556919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1123ae-f226-485c-9457-cb4576aeaef8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:51.567403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c31c9-313a-4a36-a853-53eea5e0c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:51.568095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c31c9-313a-4a36-a853-53eea5e0c64a admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.568384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c31c9-313a-4a36-a853-53eea5e0c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.568665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c31c9-313a-4a36-a853-53eea5e0c64a admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.569382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c31c9-313a-4a36-a853-53eea5e0c64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:51.574014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-53e9eed1-d957-451c-b9de-236012b795a2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.575030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c31c9-313a-4a36-a853-53eea5e0c64a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:51.575375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-53e9eed1-d957-451c-b9de-236012b795a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.591296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 760/1543] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:21:51.592635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44991e-3ac9-43c2-b3ac-18b363864732 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.592923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44991e-3ac9-43c2-b3ac-18b363864732 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.593199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44991e-3ac9-43c2-b3ac-18b363864732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.613929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4b44991e-3ac9-43c2-b3ac-18b363864732 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.615125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4b44991e-3ac9-43c2-b3ac-18b363864732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.622629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 784/1544] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:51.624406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09afac4-99c1-4166-b676-3e35a77d5e89 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.624696 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09afac4-99c1-4166-b676-3e35a77d5e89 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.624979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09afac4-99c1-4166-b676-3e35a77d5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.635285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 761/1545] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.636484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82342454-4448-4d5a-9ec2-9f87d5325e93 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.636776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82342454-4448-4d5a-9ec2-9f87d5325e93 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.637058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82342454-4448-4d5a-9ec2-9f87d5325e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.659957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c09afac4-99c1-4166-b676-3e35a77d5e89 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.668031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c09afac4-99c1-4166-b676-3e35a77d5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.668253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-82342454-4448-4d5a-9ec2-9f87d5325e93 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.668253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-82342454-4448-4d5a-9ec2-9f87d5325e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.745675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 762/1546] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.746737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82342454-4448-4d5a-9ec2-9f87d5325e93 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:51.749691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 785/1547] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.751624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae138-9e96-4209-9b2a-81395fee1ca3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.752091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae138-9e96-4209-9b2a-81395fee1ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.753547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae138-9e96-4209-9b2a-81395fee1ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.756482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82342454-4448-4d5a-9ec2-9f87d5325e93 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:51.760975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ef5e4-210a-4cfb-af42-839fab21e4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:51.761636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef5e4-210a-4cfb-af42-839fab21e4eb admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.761913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef5e4-210a-4cfb-af42-839fab21e4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.762182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef5e4-210a-4cfb-af42-839fab21e4eb admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.762892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ef5e4-210a-4cfb-af42-839fab21e4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:51.764829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ef5e4-210a-4cfb-af42-839fab21e4eb admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:51.772358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-115ae138-9e96-4209-9b2a-81395fee1ca3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.773578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-115ae138-9e96-4209-9b2a-81395fee1ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.783102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 786/1548] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.784991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc5821-750b-4da8-b0f5-3251900a6530 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.785461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc5821-750b-4da8-b0f5-3251900a6530 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.785735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc5821-750b-4da8-b0f5-3251900a6530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.790816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 763/1549] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:51.791934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee468c-3388-4b5d-9a72-8df19bdab0f1 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.792998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee468c-3388-4b5d-9a72-8df19bdab0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.793556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee468c-3388-4b5d-9a72-8df19bdab0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.806428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f9dc5821-750b-4da8-b0f5-3251900a6530 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.807684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f9dc5821-750b-4da8-b0f5-3251900a6530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.814881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-2fee468c-3388-4b5d-9a72-8df19bdab0f1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.815716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 787/1550] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.816078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2fee468c-3388-4b5d-9a72-8df19bdab0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.817120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c5db-cda1-4b91-bdd1-a6607fa3d870 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.817418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c5db-cda1-4b91-bdd1-a6607fa3d870 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.817702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c5db-cda1-4b91-bdd1-a6607fa3d870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.824519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 764/1551] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.825958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc58a4a-952c-4b32-92f8-c697346b9844 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.826246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc58a4a-952c-4b32-92f8-c697346b9844 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.826523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc58a4a-952c-4b32-92f8-c697346b9844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.843421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-0053c5db-cda1-4b91-bdd1-a6607fa3d870 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.844715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0053c5db-cda1-4b91-bdd1-a6607fa3d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.846952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5cc58a4a-952c-4b32-92f8-c697346b9844 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.848130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5cc58a4a-952c-4b32-92f8-c697346b9844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.852892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 788/1552] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.853706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c5db-cda1-4b91-bdd1-a6607fa3d870 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:51.862751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 765/1553] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.862751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d6e2f-5818-489e-816f-aba662000fd2 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.862751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d6e2f-5818-489e-816f-aba662000fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.862751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d6e2f-5818-489e-816f-aba662000fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.870159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c5db-cda1-4b91-bdd1-a6607fa3d870 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:51.874982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:51.875661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.875935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.876210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.876939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:51.877101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-9d9d6e2f-5818-489e-816f-aba662000fd2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.877247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:51.878350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING py.warnings [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:21:51.878350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: warnings.warn(msg) Jun 30 10:21:51.878350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: Jun 30 10:21:51.878630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9d9d6e2f-5818-489e-816f-aba662000fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.879297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b9c57-6fac-4460-9111-5681a0e7f1b0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:51.886777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 766/1554] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.887691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d6e2f-5818-489e-816f-aba662000fd2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:51.894258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 789/1555] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:51.895664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d34c-e603-4ae8-b533-b938f4ab9379 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.895956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d34c-e603-4ae8-b533-b938f4ab9379 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.896232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d34c-e603-4ae8-b533-b938f4ab9379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.904670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d6e2f-5818-489e-816f-aba662000fd2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:51.909249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:51.909916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.910200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.910474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.911238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:51.912874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:51.914905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1fb0d34c-e603-4ae8-b533-b938f4ab9379 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.916140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1fb0d34c-e603-4ae8-b533-b938f4ab9379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.924392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 767/1556] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:51.925193 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 790/1557] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.925313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:51.929716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2894fd6-5c23-4f29-88ac-f10e0f5106e3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.930012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2894fd6-5c23-4f29-88ac-f10e0f5106e3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.930297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2894fd6-5c23-4f29-88ac-f10e0f5106e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.935579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60de4f-bc10-43fc-9eb4-43748ea830aa admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:51.941504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37e7c0-ee10-4fe9-977e-1850fb00328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:51.943288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e7c0-ee10-4fe9-977e-1850fb00328c admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.943574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e7c0-ee10-4fe9-977e-1850fb00328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.943851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37e7c0-ee10-4fe9-977e-1850fb00328c admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.944706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37e7c0-ee10-4fe9-977e-1850fb00328c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:51.945020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37e7c0-ee10-4fe9-977e-1850fb00328c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:51.946647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37e7c0-ee10-4fe9-977e-1850fb00328c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:51.954166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c2894fd6-5c23-4f29-88ac-f10e0f5106e3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.956413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c2894fd6-5c23-4f29-88ac-f10e0f5106e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.960031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 768/1558] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:51.961306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06259eee-a9eb-4d79-b672-cd01e8a989d5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.961641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06259eee-a9eb-4d79-b672-cd01e8a989d5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.962021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06259eee-a9eb-4d79-b672-cd01e8a989d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.973796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 791/1559] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.973796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083bdd-c3bb-499b-b992-9ea8304300e9 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:51.973796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083bdd-c3bb-499b-b992-9ea8304300e9 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:51.973796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083bdd-c3bb-499b-b992-9ea8304300e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:51.987184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-06259eee-a9eb-4d79-b672-cd01e8a989d5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.988393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-06259eee-a9eb-4d79-b672-cd01e8a989d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.991262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e5083bdd-c3bb-499b-b992-9ea8304300e9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:51.992447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e5083bdd-c3bb-499b-b992-9ea8304300e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:51.996635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 769/1560] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:51.997250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06259eee-a9eb-4d79-b672-cd01e8a989d5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.000817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 792/1561] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:52.005663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083bdd-c3bb-499b-b992-9ea8304300e9 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.011287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083bdd-c3bb-499b-b992-9ea8304300e9 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.011464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06259eee-a9eb-4d79-b672-cd01e8a989d5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.017686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.017873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.017996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.018105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.018215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.018308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.018403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.018501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.018934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:52.019129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.019273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.021019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.021127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.034472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 770/1562] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:52.035370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.046520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c646b-c599-4623-aaa1-341773aa8c08 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.051613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.052279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.052562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.052842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.053571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.055235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.058721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 793/1563] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.060156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.068745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 771/1564] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:52.068745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.077077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccacee8-6766-4ed8-b22b-b74ef328f3d1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.109360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:52.127058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:52.131364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ea0f6-3253-4086-833c-5e0e4638031a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.134845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.135519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.135826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.136604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.137291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.138327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:21:52.138327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:21:52.138327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:21:52.138610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.139215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.139503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.139617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.139784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.140516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:52.140829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.142459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.155377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 794/1565] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:52.156376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.168705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 772/1566] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.169742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.173001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17b099-7e8f-48bb-ad94-5985af5b0cc4 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.231065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.231823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.232110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.232387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.233111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:52.233431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.235335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.236543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a5169-cf36-4f93-9960-a0c370a69b53 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.241337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.242007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.242294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.242749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.243482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:52.243799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.245486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.252059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 795/1567] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:52.252059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.260782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559437d2-aa2d-4473-b112-bed4761433f6 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.269158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 773/1568] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:52.269158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.271048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.271713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.272000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.272277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.273004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:52.273310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.274959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.280008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115834fb-0867-4451-a737-a61a1d773491 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.285311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.285965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.286245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.286521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.287241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.288608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 796/1569] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:52.289195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.289411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.299330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41bb45-8156-40eb-a523-64dafddf263a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.304245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.304906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.305187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.305459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.306214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.307463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING py.warnings [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:21:52.307463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: warnings.warn(msg) Jun 30 10:21:52.307463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: Jun 30 10:21:52.308646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.318770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 774/1570] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.318770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.331896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 797/1571] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.335404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.343776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae5674-03b1-4fda-815b-b0f7fe9396ed admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.386920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7a5d4-5104-4856-aebf-0240df4565de admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.391760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.392748 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.393031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.393307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] PATH_INFO: `/v3/projects/4aa8d646e8f5402593e31bacb29c11f2/users/115a0e755abb45b7919c28618b0decc9/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.403732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.404397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.404678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.404953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.405657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.408059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.410813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa8d646e8f5402593e31bacb29c11f2, user_id=115a0e755abb45b7919c28618b0decc9, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.411855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:21:52.411855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:21:52.411855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:21:52.413928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.427867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 775/1572] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:52 2022] PUT /identity/v3/projects/4aa8d646e8f5402593e31bacb29c11f2/users/115a0e755abb45b7919c28618b0decc9/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:52.428964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.442280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 798/1573] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.443349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.450894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:52.490624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:52.501468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09facf0d-b8e2-47f1-8dd7-268275db36e3 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.513788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d99301-ae5b-4de3-b019-639369c6de70 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.522761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.523522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.523806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.524118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.525986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.528576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.563068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 799/1574] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.564592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.571218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.572002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.572349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.572626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.573655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.576161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.597114 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 776/1575] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.597969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.608101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaaa57-e5d9-4b53-8b00-b736b3121a88 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.633120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a2a5-d060-4712-bd7f-0d6004e8134b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.638609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.639268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.639543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.639817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.640515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.642434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.671421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 800/1576] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.672222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.678086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.678790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.679074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.679410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.680111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.682059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.714852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 777/1577] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.716186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.748501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee8f9-286f-4852-b657-7cb7491c79f6 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.762544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:52.785895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82247c51-783a-4946-8dc6-ae5be938ad47 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.790750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03f48-f268-4590-8547-a9a041d57635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.791433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03f48-f268-4590-8547-a9a041d57635 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.791722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03f48-f268-4590-8547-a9a041d57635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.791997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03f48-f268-4590-8547-a9a041d57635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.792758 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b03f48-f268-4590-8547-a9a041d57635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.794586 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b03f48-f268-4590-8547-a9a041d57635 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.804489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:52.805037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 778/1578] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:52.806358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb793fb-f055-4a8d-8fcf-b02206e35ef4 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.806547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb793fb-f055-4a8d-8fcf-b02206e35ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.806852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb793fb-f055-4a8d-8fcf-b02206e35ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.822850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.824718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.825169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.825606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.826488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.830027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.849855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-fdb793fb-f055-4a8d-8fcf-b02206e35ef4 None None] MFA Rules not processed for user `115a0e755abb45b7919c28618b0decc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:52.852385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fdb793fb-f055-4a8d-8fcf-b02206e35ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:52.861972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 801/1579] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.861972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.873598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9bc1-ef20-4f8b-a0bf-84291fb2dc37 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.878801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.879628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.879986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.880330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.881186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.883380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.907885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 802/1580] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.909112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.923353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73501bea-ae68-463f-8450-806e71a3c5ce admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.929836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.930741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.931057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.931454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.932266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.935221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.938839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 779/1581] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:52.940027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb793fb-f055-4a8d-8fcf-b02206e35ef4 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.957146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb793fb-f055-4a8d-8fcf-b02206e35ef4 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.963256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:52.964293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:52.964641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:52.964901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:52.965903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:52.967694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:52.970671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 803/1582] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/users => generated 290 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:52.971596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.988865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862fb2-4d7d-4514-ab86-574b062b922e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:52.989405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 780/1583] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:52.990887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:52.999825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.001248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.001550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.001842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.002549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.004592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.006398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb515eb7-ab7f-4ae5-87e2-acb9f603f281 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.012560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.013703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.014186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.014501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.015428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.020179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.028078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 804/1584] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/users => generated 294 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:53.029226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.040039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb661f-93d2-4fb1-ad79-4a9cc8ba2d7d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.045907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.046707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.047031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.047400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.048149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.049992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.050480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 781/1585] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:52 2022] POST /identity/v3/users => generated 303 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:53.051366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.063356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc5a3a-e07c-4eda-80ff-1a64f8c58864 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.063844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 805/1586] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.067162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.069862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac45ca-97e7-4a06-ad06-e9554ca190fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.070561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac45ca-97e7-4a06-ad06-e9554ca190fe admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.070875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac45ca-97e7-4a06-ad06-e9554ca190fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.071155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac45ca-97e7-4a06-ad06-e9554ca190fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.071909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac45ca-97e7-4a06-ad06-e9554ca190fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.073783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac45ca-97e7-4a06-ad06-e9554ca190fe admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.076727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ce1b9-ed61-4fa8-ab5a-0598cd0db8f7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.081516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.082187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.082476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.082786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.083515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.085110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.085416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 782/1587] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.087003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d214-f117-47a4-b3f7-9e163eee038e None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.087693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d214-f117-47a4-b3f7-9e163eee038e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.088019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d214-f117-47a4-b3f7-9e163eee038e None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.089421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 783/1588] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 30 10:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:21:53.090158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d214-f117-47a4-b3f7-9e163eee038e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.100621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 806/1589] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.100621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.103376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d214-f117-47a4-b3f7-9e163eee038e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.108793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.109486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.109773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.110087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.110618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cfc6d-4aae-4350-ab48-d0a69a8cea6f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.110852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.112558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.115409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.116052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.118383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.118383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.118383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.118900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.123365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 784/1590] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.124276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.135987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 807/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.135987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.136282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87477b2c-2560-450f-87e6-5a4b1b060c65 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.139249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.139848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.140136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.140418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.141146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.143089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.143537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84146c36-8371-4ea6-9f87-a87ca09071cb admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.148544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.149185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.149468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.149747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.150458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.152075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.153279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 785/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.154069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.164123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e206f1-de01-42c0-95b1-a73b96dbb027 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.165135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 808/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.165890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.171009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.172032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.172869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.172869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] PATH_INFO: `/v3/projects/a8ac9824948a4304a818d990be8be095/users/3a73a02c00554378a981d0503bd717a4/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.176086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36863d6-bf9c-48a6-aa25-558a9f5e5f7c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.180671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a38a6-d9d6-444c-9560-b4a5505296d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.181316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a38a6-d9d6-444c-9560-b4a5505296d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.181601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a38a6-d9d6-444c-9560-b4a5505296d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.181873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a38a6-d9d6-444c-9560-b4a5505296d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.182584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a38a6-d9d6-444c-9560-b4a5505296d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.184842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a38a6-d9d6-444c-9560-b4a5505296d8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.188711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ac9824948a4304a818d990be8be095, user_id=3a73a02c00554378a981d0503bd717a4, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.191432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.194770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 809/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.196015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab23ac-d420-440a-8fa3-fb1e6b8bb0e8 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.196301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab23ac-d420-440a-8fa3-fb1e6b8bb0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.196577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab23ac-d420-440a-8fa3-fb1e6b8bb0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.208757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 786/1595] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:53 2022] PUT /identity/v3/projects/a8ac9824948a4304a818d990be8be095/users/3a73a02c00554378a981d0503bd717a4/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:53.216199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.216382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-28ab23ac-d420-440a-8fa3-fb1e6b8bb0e8 None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:53.217568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-28ab23ac-d420-440a-8fa3-fb1e6b8bb0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:53.266354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:53.290272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 810/1596] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 30 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:53.291170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab23ac-d420-440a-8fa3-fb1e6b8bb0e8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.292104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba05577-3524-4b4e-b04a-413cdd79668b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.297353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.298108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.298399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.298700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.299443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.301113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.302192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab23ac-d420-440a-8fa3-fb1e6b8bb0e8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.307888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.308551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.308833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.309119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.309832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.314572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 787/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.315013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.315135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.327703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 811/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.327937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c834f3e-d8ef-46e9-bad1-83e5eaec4b5c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.328041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.329692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.330590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.330902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.331187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] PATH_INFO: `/v3/projects/d85406a94e3c4b07852c8d61bdcfc79e/users/ecf6ed97c0eb4db68cf951044ce9ff2d/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.335253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611e5a0-3a29-49db-bcd0-dc462c1578ce admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.340355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.341000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.341278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.341553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.342299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.343925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.347711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85406a94e3c4b07852c8d61bdcfc79e, user_id=ecf6ed97c0eb4db68cf951044ce9ff2d, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.350382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.354339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 812/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.356670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.367260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd898-29be-4349-83ff-d41f15dd8782 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.372734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:53.374395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 788/1600] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:53 2022] PUT /identity/v3/projects/d85406a94e3c4b07852c8d61bdcfc79e/users/ecf6ed97c0eb4db68cf951044ce9ff2d/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:53.375794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.430289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ceacad-0289-4c75-ab34-cf33657b7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.431006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceacad-0289-4c75-ab34-cf33657b7c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.431295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceacad-0289-4c75-ab34-cf33657b7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.431576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceacad-0289-4c75-ab34-cf33657b7c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.432307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ceacad-0289-4c75-ab34-cf33657b7c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.433934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ceacad-0289-4c75-ab34-cf33657b7c20 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.438484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc813f-2973-4954-9c6b-869c91efd843 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.443218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.443747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 813/1601] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:53.444140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.444380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.444653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] PATH_INFO: `/v3/projects/82b32c43bfc24574afcbc3610b2b072b/users/6f010abeba0347c6bc43e800c1935e02/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.444966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f67d9-305e-4bd3-adcf-6cf17c64e2e3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.445273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f67d9-305e-4bd3-adcf-6cf17c64e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.445544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f67d9-305e-4bd3-adcf-6cf17c64e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.460016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b32c43bfc24574afcbc3610b2b072b, user_id=6f010abeba0347c6bc43e800c1935e02, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.462771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.472204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-315f67d9-305e-4bd3-adcf-6cf17c64e2e3 None None] MFA Rules not processed for user `3a73a02c00554378a981d0503bd717a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:53.473427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-315f67d9-305e-4bd3-adcf-6cf17c64e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:53.480522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 789/1602] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:53 2022] PUT /identity/v3/projects/82b32c43bfc24574afcbc3610b2b072b/users/6f010abeba0347c6bc43e800c1935e02/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:53.481380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.547422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 814/1603] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:53.548782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f67d9-305e-4bd3-adcf-6cf17c64e2e3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.559988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d291-ab2e-4b90-80ef-32d03c52857c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.567216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.567974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.568508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.568897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.615710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:53.624397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f67d9-305e-4bd3-adcf-6cf17c64e2e3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.629389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.630275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.630556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.630866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] PATH_INFO: `/v3/projects/f3a09af8358a4c9ba551fc573ba84e09/users/e7f3274a762a4e1c8ae1474ffcbe912d/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.645393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.647192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.651001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a09af8358a4c9ba551fc573ba84e09, user_id=e7f3274a762a4e1c8ae1474ffcbe912d, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.654243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.657408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 790/1604] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:53.657998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.669265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274daf6-f599-4805-ac2c-8839d9a22130 service nova] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.675239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 815/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:53 2022] PUT /identity/v3/projects/f3a09af8358a4c9ba551fc573ba84e09/users/e7f3274a762a4e1c8ae1474ffcbe912d/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:53.675997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.697176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:53.736857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58bbcc-53a9-4d11-9e56-d464f1e186f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.737752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58bbcc-53a9-4d11-9e56-d464f1e186f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.738042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58bbcc-53a9-4d11-9e56-d464f1e186f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.738318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58bbcc-53a9-4d11-9e56-d464f1e186f0 admin admin] PATH_INFO: `/v3/projects/2cb665dac9894afc81d3f4dedfdbc551/users/62374595979246448444c17ee227a420/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.742404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9027eb-1e70-4bb5-8015-20848fdaec02 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.747219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.748307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.748593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.748870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] PATH_INFO: `/v3/projects/97676089d6c14acc83bca866d0fae6e2/users/4c65e6495f7e43408c26706c89f61ad0/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.753565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58bbcc-53a9-4d11-9e56-d464f1e186f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb665dac9894afc81d3f4dedfdbc551, user_id=62374595979246448444c17ee227a420, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.756282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58bbcc-53a9-4d11-9e56-d464f1e186f0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.765390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97676089d6c14acc83bca866d0fae6e2, user_id=4c65e6495f7e43408c26706c89f61ad0, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.768115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.771392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 791/1606] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:53 2022] PUT /identity/v3/projects/2cb665dac9894afc81d3f4dedfdbc551/users/62374595979246448444c17ee227a420/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:53.772520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe43b8-358f-4374-9e32-076f5c261e46 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.772815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe43b8-358f-4374-9e32-076f5c261e46 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.773094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe43b8-358f-4374-9e32-076f5c261e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.788150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 816/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:53 2022] PUT /identity/v3/projects/97676089d6c14acc83bca866d0fae6e2/users/4c65e6495f7e43408c26706c89f61ad0/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:53.788970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:53.797412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d8fe43b8-358f-4374-9e32-076f5c261e46 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:53.798825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d8fe43b8-358f-4374-9e32-076f5c261e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:53.859409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68545aef-008b-4f6c-aeed-a8c2d9067fb7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:53.864370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bfac9-4638-4a15-b7f6-202d96af5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:53.865267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfac9-4638-4a15-b7f6-202d96af5f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.865549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfac9-4638-4a15-b7f6-202d96af5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.865833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfac9-4638-4a15-b7f6-202d96af5f1b admin admin] PATH_INFO: `/v3/projects/17056207301e45c9a0db8f380bb96424/users/a9ad18964f934a058a128e5186c8933e/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.873253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 792/1608] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:53.874812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f91f-8471-44b3-8382-1613b95bf37e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.875110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f91f-8471-44b3-8382-1613b95bf37e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.875389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f91f-8471-44b3-8382-1613b95bf37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.885818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bfac9-4638-4a15-b7f6-202d96af5f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17056207301e45c9a0db8f380bb96424, user_id=a9ad18964f934a058a128e5186c8933e, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:53.889188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bfac9-4638-4a15-b7f6-202d96af5f1b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:53.919962 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-edf5f91f-8471-44b3-8382-1613b95bf37e None None] MFA Rules not processed for user `6f010abeba0347c6bc43e800c1935e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:53.922511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 817/1609] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:53 2022] PUT /identity/v3/projects/17056207301e45c9a0db8f380bb96424/users/a9ad18964f934a058a128e5186c8933e/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:53.922511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c9fa-d72a-4222-9938-b677c548c136 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.922511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c9fa-d72a-4222-9938-b677c548c136 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.922511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569c9fa-d72a-4222-9938-b677c548c136 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.922511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 818/1610] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 30 10:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:21:53.922511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d451-c6a1-4eb7-866e-ef0d81a14893 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:53.923865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d451-c6a1-4eb7-866e-ef0d81a14893 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:53.923966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-edf5f91f-8471-44b3-8382-1613b95bf37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:53.924058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3d451-c6a1-4eb7-866e-ef0d81a14893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:53.947453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-30d3d451-c6a1-4eb7-866e-ef0d81a14893 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:53.949838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-30d3d451-c6a1-4eb7-866e-ef0d81a14893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:53.973882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:54.001353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 793/1611] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:54.003005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb817-027e-4119-b65d-41826cc67a6e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.003297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb817-027e-4119-b65d-41826cc67a6e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.003578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb817-027e-4119-b65d-41826cc67a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.021001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-2fccb817-027e-4119-b65d-41826cc67a6e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:54.021204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 819/1612] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:54.022263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2fccb817-027e-4119-b65d-41826cc67a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:54.022405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871874-97a6-4bd2-bda1-560d77470dbf None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.022713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871874-97a6-4bd2-bda1-560d77470dbf None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.023003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871874-97a6-4bd2-bda1-560d77470dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.030613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 794/1613] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:54.032070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccb817-027e-4119-b65d-41826cc67a6e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.044219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-32871874-97a6-4bd2-bda1-560d77470dbf None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:54.045452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-32871874-97a6-4bd2-bda1-560d77470dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:54.053420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 820/1614] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:54.054758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be936-ee9d-46fe-be64-33119a2b2b78 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.055057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be936-ee9d-46fe-be64-33119a2b2b78 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.055340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be936-ee9d-46fe-be64-33119a2b2b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.082833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6c7be936-ee9d-46fe-be64-33119a2b2b78 None None] MFA Rules not processed for user `a9ad18964f934a058a128e5186c8933e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:54.084054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6c7be936-ee9d-46fe-be64-33119a2b2b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:54.088557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccb817-027e-4119-b65d-41826cc67a6e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.089215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:54.092799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0bab-b55a-4030-8a02-ce450193e2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.093454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0bab-b55a-4030-8a02-ce450193e2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.093737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0bab-b55a-4030-8a02-ce450193e2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.094463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0bab-b55a-4030-8a02-ce450193e2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.104500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0bab-b55a-4030-8a02-ce450193e2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.106302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0bab-b55a-4030-8a02-ce450193e2b4 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.116847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 795/1615] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:54.118238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701cb72-4f72-438e-9daa-c3decae58d49 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.118623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701cb72-4f72-438e-9daa-c3decae58d49 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.119018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701cb72-4f72-438e-9daa-c3decae58d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.140062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-2701cb72-4f72-438e-9daa-c3decae58d49 None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:54.141283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2701cb72-4f72-438e-9daa-c3decae58d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:54.155501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 821/1616] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:54.157075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c67ac-6635-4e95-a436-c8edff1e6405 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.157373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c67ac-6635-4e95-a436-c8edff1e6405 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.157708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c67ac-6635-4e95-a436-c8edff1e6405 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.159441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 822/1617] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 30 10:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:21:54.160065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c67ac-6635-4e95-a436-c8edff1e6405 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.173868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c67ac-6635-4e95-a436-c8edff1e6405 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.179937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.180765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.181054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.181339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.182506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.185254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.213656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 823/1618] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:54.214894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.221481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:54.232068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 796/1619] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:54.233255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701cb72-4f72-438e-9daa-c3decae58d49 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.242634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701cb72-4f72-438e-9daa-c3decae58d49 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.289363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200369ee-862e-4a94-bf34-b97d640c024b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.293788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.294782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.295050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.295334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.305200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.306091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.306422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.306829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.346258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:54.389001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.390486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.391421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.392876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.401682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 824/1620] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:54.402568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.412239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07dc91-83f0-42da-9b4f-63356e3b01ed service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.413886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 797/1621] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:54.415566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.418270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f0af1-7814-4f87-a9e7-ae25319f5e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.423434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0af1-7814-4f87-a9e7-ae25319f5e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.423873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0af1-7814-4f87-a9e7-ae25319f5e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.424409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0af1-7814-4f87-a9e7-ae25319f5e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.434034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247374-2f79-4f17-9f19-e66db18032f7 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.439719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f0af1-7814-4f87-a9e7-ae25319f5e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.441226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.441704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f0af1-7814-4f87-a9e7-ae25319f5e63 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.442504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.443027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.443448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.444491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.447087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.453509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 825/1622] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:54.455023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ceebf-bbc0-420d-9d71-eba8acd0a18c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.455501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ceebf-bbc0-420d-9d71-eba8acd0a18c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.455888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ceebf-bbc0-420d-9d71-eba8acd0a18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.479270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d32ceebf-bbc0-420d-9d71-eba8acd0a18c None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:54.481478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d32ceebf-bbc0-420d-9d71-eba8acd0a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:54.502406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 798/1623] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:54.502406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.508079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:54.586081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1791-4db8-41cc-8f28-5496149187d1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.592595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.593220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.593356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.593889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.595066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.597179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.625238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 799/1624] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:54.626501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.650008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 826/1625] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:54.653150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ceebf-bbc0-420d-9d71-eba8acd0a18c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.680270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ceebf-bbc0-420d-9d71-eba8acd0a18c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.695567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.696326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.696578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.696852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.697619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.704454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.730225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b78473-bca8-4eaf-9505-5dcc995f8600 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.738346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.739323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.739612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.740008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.766289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 827/1626] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:54 2022] POST /identity/v3/users => generated 309 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:54.766289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.778440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:54.781104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490d6ca-39f6-4818-801a-eebf94bc6d99 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.789074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.789732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.790094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.791115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.792017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.795173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.825532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 828/1627] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:54.830610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.833660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.838434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.856792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 800/1628] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:54.857527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.871825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596cd40-7a68-4726-879f-7b31097a329b service nova] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.878796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.879252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.879845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.879974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.881020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:54.882727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:54.899941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 801/1629] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:54.899941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:54.942571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909fa46-6fa4-4f0a-8521-51ea61f48c25 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:54.959984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:54.962580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:54.963626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:54.964029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] PATH_INFO: `/v3/projects/7682038b798d47f694754ec4ff70667b/users/5fa64c48e1b443338d6d45dc9ad41107/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:54.994782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195be6d9-98bd-4734-9b06-a56a3ed55a5b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.003246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.003639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7682038b798d47f694754ec4ff70667b, user_id=5fa64c48e1b443338d6d45dc9ad41107, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.004286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.004625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.005043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.013634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.029671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.031822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.040395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 802/1630] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:54 2022] PUT /identity/v3/projects/7682038b798d47f694754ec4ff70667b/users/5fa64c48e1b443338d6d45dc9ad41107/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:55.041282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.072869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 829/1631] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:55.074442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.090981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f39cba-420f-4d67-9053-9723c2d0f23b service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.168196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.169053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.169432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.169786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.170934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.173735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.188761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 830/1632] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:55.195506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.212022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e8863-bf4c-4a5b-a29c-15cdadfbb910 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.220409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02c610-0b3b-4c79-9d5a-fee608cce920 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.228019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a953e10-8175-423b-a844-dfa388a5a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.228944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953e10-8175-423b-a844-dfa388a5a32f admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.229300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953e10-8175-423b-a844-dfa388a5a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.229582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953e10-8175-423b-a844-dfa388a5a32f admin admin] PATH_INFO: `/v3/projects/6f19eff73074416bbe1fa19620f33d92/users/fec0d778d3cc41a1bdaa10739154a22c/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.234967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15916-c86e-4495-99c7-e152a2b29b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.236190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15916-c86e-4495-99c7-e152a2b29b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.236190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15916-c86e-4495-99c7-e152a2b29b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.236190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15916-c86e-4495-99c7-e152a2b29b61 admin admin] PATH_INFO: `/v3/projects/7682038b798d47f694754ec4ff70667b/users/5fa64c48e1b443338d6d45dc9ad41107/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.241355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15916-c86e-4495-99c7-e152a2b29b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7682038b798d47f694754ec4ff70667b, user_id=5fa64c48e1b443338d6d45dc9ad41107, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.244920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15916-c86e-4495-99c7-e152a2b29b61 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.266592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a953e10-8175-423b-a844-dfa388a5a32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f19eff73074416bbe1fa19620f33d92, user_id=fec0d778d3cc41a1bdaa10739154a22c, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.268655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 831/1633] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:55 2022] PUT /identity/v3/projects/7682038b798d47f694754ec4ff70667b/users/5fa64c48e1b443338d6d45dc9ad41107/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:55.269944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a953e10-8175-423b-a844-dfa388a5a32f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.270102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28507a-8e0d-426e-8dc7-65f6bb64df8b None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.270400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28507a-8e0d-426e-8dc7-65f6bb64df8b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.270700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28507a-8e0d-426e-8dc7-65f6bb64df8b None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.272371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 832/1634] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 30 10:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:21:55.278736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca170-82c9-48d4-b754-2f4d994af602 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.279046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca170-82c9-48d4-b754-2f4d994af602 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.279318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca170-82c9-48d4-b754-2f4d994af602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.302039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 803/1635] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:55 2022] PUT /identity/v3/projects/6f19eff73074416bbe1fa19620f33d92/users/fec0d778d3cc41a1bdaa10739154a22c/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:55.302039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673d195-7355-4df6-89df-24fada94d5ac None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.302039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673d195-7355-4df6-89df-24fada94d5ac None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.302039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673d195-7355-4df6-89df-24fada94d5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.306926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:55.322815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bf5ca170-82c9-48d4-b754-2f4d994af602 None None] MFA Rules not processed for user `5fa64c48e1b443338d6d45dc9ad41107`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:55.325944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bf5ca170-82c9-48d4-b754-2f4d994af602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:55.346324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6673d195-7355-4df6-89df-24fada94d5ac None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:55.347609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6673d195-7355-4df6-89df-24fada94d5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:55.437462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 833/1636] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:55.438529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ca170-82c9-48d4-b754-2f4d994af602 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.506219 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 804/1637] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:55.507715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673d195-7355-4df6-89df-24fada94d5ac None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.520248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:55.554930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ca170-82c9-48d4-b754-2f4d994af602 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.561268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.562364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.562740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.563095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.563967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.566780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.583374 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 834/1638] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:55.584494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.596599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673d195-7355-4df6-89df-24fada94d5ac None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.597530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651675c9-5ffa-441a-acdc-a8157b7b02b9 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.601787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.602393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0931a-4e08-41eb-b2dc-45d26f8d0ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.602963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.603218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0931a-4e08-41eb-b2dc-45d26f8d0ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.603570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0931a-4e08-41eb-b2dc-45d26f8d0ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.603933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0931a-4e08-41eb-b2dc-45d26f8d0ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.604066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.604522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.627321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0931a-4e08-41eb-b2dc-45d26f8d0ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.628969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0931a-4e08-41eb-b2dc-45d26f8d0ff9 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.630617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.632386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.644916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 805/1639] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:55.645342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.652745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 835/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:55.661714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c78969-7133-4a23-aab5-3de4a6a63b99 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.670455 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.671744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.672031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.672310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] PATH_INFO: `/v3/projects/6f19eff73074416bbe1fa19620f33d92/users/fec0d778d3cc41a1bdaa10739154a22c/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.674711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f19eff73074416bbe1fa19620f33d92, user_id=fec0d778d3cc41a1bdaa10739154a22c, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.677666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:55.703630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 806/1641] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:55 2022] PUT /identity/v3/projects/6f19eff73074416bbe1fa19620f33d92/users/fec0d778d3cc41a1bdaa10739154a22c/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:55.704825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7853-0f92-4db4-8081-821b2cf9567b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.705570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7853-0f92-4db4-8081-821b2cf9567b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.707659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab7853-0f92-4db4-8081-821b2cf9567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.753259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-efab7853-0f92-4db4-8081-821b2cf9567b None None] MFA Rules not processed for user `fec0d778d3cc41a1bdaa10739154a22c`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:55.759629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-efab7853-0f92-4db4-8081-821b2cf9567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:55.774067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.857788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 836/1642] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:55.910457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab7853-0f92-4db4-8081-821b2cf9567b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:55.918565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:55.975958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9889-98b4-49a4-9d0d-dec016dfe287 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:55.982639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:55.983889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:55.984623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:55.984752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] PATH_INFO: `/v3/users/115a0e755abb45b7919c28618b0decc9` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:55.986738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] RBAC: Authorizing `identity:delete_user(user_id=115a0e755abb45b7919c28618b0decc9)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:55.988079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: WARNING py.warnings [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:21:55.988079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: warnings.warn(msg) Jun 30 10:21:55.988079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: Jun 30 10:21:55.990598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:56.054252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab7853-0f92-4db4-8081-821b2cf9567b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:56.062069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfb6f9-fc07-4fa5-b543-6d1b5b27404d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:56.062758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfb6f9-fc07-4fa5-b543-6d1b5b27404d service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:56.068856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfb6f9-fc07-4fa5-b543-6d1b5b27404d service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:56.069183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfb6f9-fc07-4fa5-b543-6d1b5b27404d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:56.077326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115a0e755abb45b7919c28618b0decc9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:56.098012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfb6f9-fc07-4fa5-b543-6d1b5b27404d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:56.099414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfb6f9-fc07-4fa5-b543-6d1b5b27404d service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:56.107111 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115a0e755abb45b7919c28618b0decc9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:56.108399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115a0e755abb45b7919c28618b0decc9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:56.108735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115a0e755abb45b7919c28618b0decc9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:56.112633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 837/1643] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:56.121701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115a0e755abb45b7919c28618b0decc9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:56.168019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 807/1644] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:21:55 2022] DELETE /identity/v3/users/115a0e755abb45b7919c28618b0decc9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:21:56.173230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:56.173516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:56.173793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:56.207425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:56.212126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:56.235095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:56.236997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:56.282623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:56.434675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 838/1645] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:56.446340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:56.447314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b92d-dd1a-4c12-854c-128caef4625b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:56.453297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:56.459066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:56.459755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:56.460041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:56.460311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:56.462384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:56.600506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:56.603405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:56.638277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 808/1646] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:21:56.644812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ace1-66b6-42fb-86a7-7e5b8f63a536 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:56.674281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc563b7-65dc-4b77-9c83-3da616e097fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:56.675084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc563b7-65dc-4b77-9c83-3da616e097fa service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:56.675371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc563b7-65dc-4b77-9c83-3da616e097fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:56.675649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc563b7-65dc-4b77-9c83-3da616e097fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:56.719890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc563b7-65dc-4b77-9c83-3da616e097fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:56.721692 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc563b7-65dc-4b77-9c83-3da616e097fa service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:56.753670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 839/1647] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:57.230913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:57.232846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:57.255081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920dd59-9062-4c45-b072-165de41045d7 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:57.262006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:57.263337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:57.264263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:57.264760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] PATH_INFO: `/v3/users/a9ad18964f934a058a128e5186c8933e` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:57.266669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ad18964f934a058a128e5186c8933e)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:57.269133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:57.347208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ad18964f934a058a128e5186c8933e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:57.372228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ad18964f934a058a128e5186c8933e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:57.372994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ad18964f934a058a128e5186c8933e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:57.373617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ad18964f934a058a128e5186c8933e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:57.382774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ad18964f934a058a128e5186c8933e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:57.404336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 809/1648] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:21:57 2022] DELETE /identity/v3/users/a9ad18964f934a058a128e5186c8933e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:57.408767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:57.409197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:57.409676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:57.444715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:57.449644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:57.567181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:57.624153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 840/1649] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:57.658321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:57.661521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:57.735399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:57.760301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f86c1f-e645-4597-94af-e50acd91b060 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:57.767038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9935c5-0b35-46ba-a3f2-94b92bd4d6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:57.768797 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9935c5-0b35-46ba-a3f2-94b92bd4d6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:57.769264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9935c5-0b35-46ba-a3f2-94b92bd4d6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:57.770108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9935c5-0b35-46ba-a3f2-94b92bd4d6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:57.785916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9935c5-0b35-46ba-a3f2-94b92bd4d6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:57.788312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9935c5-0b35-46ba-a3f2-94b92bd4d6f6 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:57.804610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 810/1650] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:21:58.171620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:58.173108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:58.199273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93722a4-34ce-406b-ab37-5681288face2 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:58.225490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:58.226387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:58.227077 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:58.235766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] PATH_INFO: `/v3/projects/4aa8d646e8f5402593e31bacb29c11f2` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:58.240779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa8d646e8f5402593e31bacb29c11f2)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:58.241853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: WARNING py.warnings [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 10:21:58.241853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: warnings.warn(msg) Jun 30 10:21:58.241853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: Jun 30 10:21:58.243403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:58.459924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa8d646e8f5402593e31bacb29c11f2', 'request_id': 'req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:58.472477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa8d646e8f5402593e31bacb29c11f2', 'request_id': 'req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:58.491821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa8d646e8f5402593e31bacb29c11f2', 'request_id': 'req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:58.523918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] The token cache is being invalidate because project 4aa8d646e8f5402593e31bacb29c11f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:21:58.524764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:58.525530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f4a6fec-1746-42b1-a4e0-5e6434f8dcd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:58.528325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 841/1651] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:21:58 2022] DELETE /identity/v3/projects/4aa8d646e8f5402593e31bacb29c11f2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:58.533176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3927-8e4c-4635-a084-9b7729737f19 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:58.533703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3927-8e4c-4635-a084-9b7729737f19 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:58.534175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa3927-8e4c-4635-a084-9b7729737f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:58.568096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-64fa3927-8e4c-4635-a084-9b7729737f19 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:58.569888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-64fa3927-8e4c-4635-a084-9b7729737f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:58.710072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 811/1652] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:58.724628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17127-990d-40ed-a1fe-e97a6c2d6add None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:58.724920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17127-990d-40ed-a1fe-e97a6c2d6add None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:58.725203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17127-990d-40ed-a1fe-e97a6c2d6add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:58.760935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5ae17127-990d-40ed-a1fe-e97a6c2d6add None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:58.762377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5ae17127-990d-40ed-a1fe-e97a6c2d6add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:58.788007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 842/1653] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:58.788738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa3927-8e4c-4635-a084-9b7729737f19 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:58.799549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa3927-8e4c-4635-a084-9b7729737f19 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:58.815650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:58.816349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:58.816642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:58.817031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:58.817783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:21:58.818097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:58.819938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:58.854637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 812/1654] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:21:58.855980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae17127-990d-40ed-a1fe-e97a6c2d6add None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:58.867928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae17127-990d-40ed-a1fe-e97a6c2d6add None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:58.890970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:58.893672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:58.895048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:58.896710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:58.899179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:58.904564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:59.024266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 843/1655] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:58 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:21:59.029654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:59.041528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa45b72-aa74-41ba-93fe-5e020989384a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:59.161637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:59.163116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.163886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.164399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.166297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:59.169166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:59.178446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:59.180732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:59.203920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 813/1656] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:21:59 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:21:59.208189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:59.304863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff778f-8f07-4b33-82c8-59ac8865a389 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:59.304863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:59.304863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.304863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.309266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.309266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:59.309266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:59.310439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c395899-17e3-476f-8891-cc93f7e26a76 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:59.324860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:59.325756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.326042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.326322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] PATH_INFO: `/v3/projects/17056207301e45c9a0db8f380bb96424` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.366376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 814/1657] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:59.366376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:59.366376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a0c63-3ed1-4d8c-9f05-b3a0896e6004 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:59.375247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:59.375636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17056207301e45c9a0db8f380bb96424)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:59.376226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.376812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.377247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.378537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:59.383437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:59.401327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:59.416059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 815/1658] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:21:59.417530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:59.445358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a45a9-2af6-40da-859d-aa820c9e2178 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:59.465064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7c44f-1479-4e3f-8176-189f44890ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:59.466587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c44f-1479-4e3f-8176-189f44890ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.467016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c44f-1479-4e3f-8176-189f44890ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.467386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c44f-1479-4e3f-8176-189f44890ebe admin admin] PATH_INFO: `/v3/projects/2b5c69d54af249e692d5e02c8adcd50f/users/fc12a129e9994df38f1422ca58aa3305/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.509838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7c44f-1479-4e3f-8176-189f44890ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5c69d54af249e692d5e02c8adcd50f, user_id=fc12a129e9994df38f1422ca58aa3305, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:59.514893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7c44f-1479-4e3f-8176-189f44890ebe admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:59.538148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 816/1659] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:21:59 2022] PUT /identity/v3/projects/2b5c69d54af249e692d5e02c8adcd50f/users/fc12a129e9994df38f1422ca58aa3305/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:21:59.565273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.566012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.566897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.625439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:59.625778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17056207301e45c9a0db8f380bb96424', 'request_id': 'req-cdeab1ec-a122-43d7-af50-e95177e2f6c3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:59.638991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] MFA Rules not processed for user `fc12a129e9994df38f1422ca58aa3305`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:21:59.640387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:59.643758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17056207301e45c9a0db8f380bb96424', 'request_id': 'req-cdeab1ec-a122-43d7-af50-e95177e2f6c3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:59.657026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17056207301e45c9a0db8f380bb96424', 'request_id': 'req-cdeab1ec-a122-43d7-af50-e95177e2f6c3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:59.687771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] The token cache is being invalidate because project 17056207301e45c9a0db8f380bb96424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:21:59.687946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:59.690206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:59.696847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 844/1660] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:21:59 2022] DELETE /identity/v3/projects/17056207301e45c9a0db8f380bb96424 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:21:59.698060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:59.704656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:59.771328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:21:59.848420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeab1ec-a122-43d7-af50-e95177e2f6c3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:59.862727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 817/1661] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:21:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:21:59.863252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:59.863971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:21:59.864072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.864255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.865690 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] PATH_INFO: `/v3/users/fec0d778d3cc41a1bdaa10739154a22c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.867425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec0d778d3cc41a1bdaa10739154a22c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:59.868093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:21:59.869416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:21:59.918335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a4efc-3aac-494a-ba1f-fd4c6febcf97 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:21:59.939313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:21:59.941049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:21:59.941860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:21:59.942228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:21:59.983922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec0d778d3cc41a1bdaa10739154a22c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:21:59.986012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:21:59.988996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:00.024813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec0d778d3cc41a1bdaa10739154a22c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:00.028707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec0d778d3cc41a1bdaa10739154a22c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:00.029993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec0d778d3cc41a1bdaa10739154a22c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:00.048797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec0d778d3cc41a1bdaa10739154a22c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:00.085509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 845/1662] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:21:59 2022] DELETE /identity/v3/users/fec0d778d3cc41a1bdaa10739154a22c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:00.122287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:00.123902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:00.124899 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 818/1663] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:21:59 2022] POST /identity/v3/projects => generated 379 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:00.292616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a737768-4758-4ccb-a3a8-5fa9363fc210 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:00.408437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:00.427644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:00.428689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:00.431715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:00.432151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:00.434478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:00.497985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:00.572903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 846/1664] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:00 2022] POST /identity/v3/users => generated 296 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:00.576986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:00.592556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14e6ee-a58c-4869-bdd9-53d4cc6f304f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:00.612609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:00.613297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:00.613583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:00.613837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:00.614574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:00.616439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:00.659973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 819/1665] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:00.661648 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:00.678936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc2962-e475-4aab-9fd0-431d94468c65 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:00.691520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:00.692658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:00.692837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:00.693073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] PATH_INFO: `/v3/projects/57501975468e4c569850b8bc85fc659a/users/288422b03c1d44b5bf7a7dbbe491ef74/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:00.724207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57501975468e4c569850b8bc85fc659a, user_id=288422b03c1d44b5bf7a7dbbe491ef74, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:00.728302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:00.755065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 847/1666] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:00 2022] PUT /identity/v3/projects/57501975468e4c569850b8bc85fc659a/users/288422b03c1d44b5bf7a7dbbe491ef74/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:00.759093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:00.774939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357890fd-4c1b-4af4-95d9-a23695b95e3c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:00.886936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b91451-06f0-4b44-a835-ec76b5f38b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:00.887830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91451-06f0-4b44-a835-ec76b5f38b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:00.888658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91451-06f0-4b44-a835-ec76b5f38b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:00.889105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b91451-06f0-4b44-a835-ec76b5f38b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:00.890089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b91451-06f0-4b44-a835-ec76b5f38b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:00.892473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b91451-06f0-4b44-a835-ec76b5f38b8e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:00.914469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 820/1667] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:00.923087 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:00.951879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09c5c0-a12f-4718-a574-7d1cb68bb55f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:00.966680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:00.967864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:00.969276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:00.969276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] PATH_INFO: `/v3/projects/57501975468e4c569850b8bc85fc659a/users/288422b03c1d44b5bf7a7dbbe491ef74/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:00.971820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57501975468e4c569850b8bc85fc659a, user_id=288422b03c1d44b5bf7a7dbbe491ef74, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:00.975242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:00.998617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 848/1668] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:00 2022] PUT /identity/v3/projects/57501975468e4c569850b8bc85fc659a/users/288422b03c1d44b5bf7a7dbbe491ef74/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:01.012953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:01.017135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:01.020010 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:01.091773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] MFA Rules not processed for user `288422b03c1d44b5bf7a7dbbe491ef74`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:01.092955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:01.252273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:01.305974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 821/1669] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:01.318661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:01.320589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:01.435357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac6762-a9c6-4c4f-99b3-750e2b1c9ea0 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:01.444782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bdd90-67d4-4c4c-8a20-ee64c1de7858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:01.445627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdd90-67d4-4c4c-8a20-ee64c1de7858 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:01.446511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdd90-67d4-4c4c-8a20-ee64c1de7858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:01.447103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bdd90-67d4-4c4c-8a20-ee64c1de7858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:01.475558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bdd90-67d4-4c4c-8a20-ee64c1de7858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:01.481433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bdd90-67d4-4c4c-8a20-ee64c1de7858 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:01.518559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 849/1670] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:01.672815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:01.674669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:01.893513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b641b0-2cfe-462c-8f6d-87171a7769c8 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:01.913059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:01.914062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:01.914457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:01.914878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] PATH_INFO: `/v3/projects/6f19eff73074416bbe1fa19620f33d92` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:01.921240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f19eff73074416bbe1fa19620f33d92)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:01.923829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.067529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f19eff73074416bbe1fa19620f33d92', 'request_id': 'req-17acf4b7-b983-4e24-bcf4-6182f9e9856f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:02.088514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f19eff73074416bbe1fa19620f33d92', 'request_id': 'req-17acf4b7-b983-4e24-bcf4-6182f9e9856f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:02.100543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f19eff73074416bbe1fa19620f33d92', 'request_id': 'req-17acf4b7-b983-4e24-bcf4-6182f9e9856f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:02.145872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] The token cache is being invalidate because project 6f19eff73074416bbe1fa19620f33d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:02.146167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:02.156610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-17acf4b7-b983-4e24-bcf4-6182f9e9856f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:02.160046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 822/1671] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:01 2022] DELETE /identity/v3/projects/6f19eff73074416bbe1fa19620f33d92 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:02.166245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bdd34-ce07-4e96-b9f8-74cda38b593d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.166534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bdd34-ce07-4e96-b9f8-74cda38b593d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.167184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bdd34-ce07-4e96-b9f8-74cda38b593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.207569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-238bdd34-ce07-4e96-b9f8-74cda38b593d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:02.211847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-238bdd34-ce07-4e96-b9f8-74cda38b593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:02.390064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 850/1672] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:02.397799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f2c-15a2-4dd2-9fbb-292aae80aa2a None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.398085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f2c-15a2-4dd2-9fbb-292aae80aa2a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.398461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae89f2c-15a2-4dd2-9fbb-292aae80aa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.444299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-2ae89f2c-15a2-4dd2-9fbb-292aae80aa2a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:02.444299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2ae89f2c-15a2-4dd2-9fbb-292aae80aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:02.455173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 823/1673] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:02.459613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bdd34-ce07-4e96-b9f8-74cda38b593d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.475171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bdd34-ce07-4e96-b9f8-74cda38b593d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:02.485117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:02.486151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.486610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.487252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.489244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:02.489739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:02.492247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.507319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 851/1674] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:22:02.512212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f2c-15a2-4dd2-9fbb-292aae80aa2a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.524689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae89f2c-15a2-4dd2-9fbb-292aae80aa2a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:02.536286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:02.538232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.538542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.538873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.539770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:02.549194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.551290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:02.565691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.649285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 824/1675] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:02 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:02.653956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.657205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:02.689061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36edbc-91ae-4cb1-8e6f-bad07f783b2c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:02.763990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:02.784492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8d79-39d0-4ad1-bdaf-1840137515a2 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:02.797885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:02.799018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.799815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.800094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.800809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:02.803225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.843447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288422b03c1d44b5bf7a7dbbe491ef74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57501975468e4c569850b8bc85fc659a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:02.843687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 825/1676] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:02 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:02.844658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.845093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.845516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.846647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:02.847131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:02.847430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.849903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.868011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15702ebb-f8f2-4498-bf84-ca9955b6b43e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:02.868483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 852/1677] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:22:02.869659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.880644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:02.881536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.882438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.882750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.884520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:02.892112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73985698-6897-48ff-aa3a-1e536b28d817 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:02.892344 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.898552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288422b03c1d44b5bf7a7dbbe491ef74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57501975468e4c569850b8bc85fc659a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:02.899767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.900252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.900679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.902202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:02.904400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.923805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 826/1678] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:02.928080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.953033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200cab9-6113-44f2-b013-f62f821616aa admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:02.960379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:02.961135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:02.961420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:02.961711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:02.962426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:02.964870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:02.970453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 853/1679] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:02 2022] POST /identity/v3/projects => generated 353 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:02.972921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:02.993382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 827/1680] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:02.997433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:03.016205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941df12-7c44-4a6c-a431-e6162c909c57 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:03.090012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69cbea-dacd-4a6d-892e-c7092bfb42af tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:03.096431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925f58d-6eb2-45f6-acdf-9460549d6f98 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288422b03c1d44b5bf7a7dbbe491ef74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57501975468e4c569850b8bc85fc659a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:03.097128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925f58d-6eb2-45f6-acdf-9460549d6f98 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:03.097409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925f58d-6eb2-45f6-acdf-9460549d6f98 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:03.097683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925f58d-6eb2-45f6-acdf-9460549d6f98 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:03.103798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925f58d-6eb2-45f6-acdf-9460549d6f98 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:03.108658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925f58d-6eb2-45f6-acdf-9460549d6f98 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:03.116473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925f58d-6eb2-45f6-acdf-9460549d6f98 tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:03.143912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:03.144854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:03.145139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:03.145417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] PATH_INFO: `/v3/projects/2678a302ff274f4090642cbad0043619/users/bfffa95d81694117945a7794ac1cc847/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:03.170220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 854/1681] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:03.189183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2678a302ff274f4090642cbad0043619, user_id=bfffa95d81694117945a7794ac1cc847, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:03.191961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:03.222179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 828/1682] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:02 2022] PUT /identity/v3/projects/2678a302ff274f4090642cbad0043619/users/bfffa95d81694117945a7794ac1cc847/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:03.241510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36236a48-d58a-413c-bd9f-ba087b0334b0 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:03.241807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36236a48-d58a-413c-bd9f-ba087b0334b0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:03.242125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36236a48-d58a-413c-bd9f-ba087b0334b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:03.262341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:03.289803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-36236a48-d58a-413c-bd9f-ba087b0334b0 None None] MFA Rules not processed for user `bfffa95d81694117945a7794ac1cc847`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:03.291832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-36236a48-d58a-413c-bd9f-ba087b0334b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:03.447910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:03.461609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb23f-716d-4e5d-91dd-d06483746098 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:03.473297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '288422b03c1d44b5bf7a7dbbe491ef74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57501975468e4c569850b8bc85fc659a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:03.477867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:03.477867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:03.477867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] PATH_INFO: `/v3/projects/209e4f672fa44d0c926c249c94a54f85` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:03.478887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorizing `identity:delete_project(project_id=209e4f672fa44d0c926c249c94a54f85)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:03.489103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:03.565151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 855/1683] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:03.566798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36236a48-d58a-413c-bd9f-ba087b0334b0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:03.594553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:03.600861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209e4f672fa44d0c926c249c94a54f85', 'request_id': 'req-69bce2f0-6605-4222-b2bc-8fc31558747e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:03.619072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209e4f672fa44d0c926c249c94a54f85', 'request_id': 'req-69bce2f0-6605-4222-b2bc-8fc31558747e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:03.634256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209e4f672fa44d0c926c249c94a54f85', 'request_id': 'req-69bce2f0-6605-4222-b2bc-8fc31558747e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:03.662729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] The token cache is being invalidate because project 209e4f672fa44d0c926c249c94a54f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:03.662729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:03.663201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:03.679161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 829/1684] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:03 2022] DELETE /identity/v3/projects/209e4f672fa44d0c926c249c94a54f85 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:03.812013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36236a48-d58a-413c-bd9f-ba087b0334b0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:04.043584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:04.044256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.044545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.044822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.045529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:04.047495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:04.096602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 856/1685] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:03 2022] POST /identity/v3/projects => generated 381 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:04.097543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:04.101443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:04.135475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce2f0-6605-4222-b2bc-8fc31558747e tempest-VolumeQuotaClassesTest-627082023 tempest-VolumeQuotaClassesTest-627082023-project-admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:04.285691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:04.287557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:04.359419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:04.360112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.360681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.361095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.361803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:04.365490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:04.418743 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 830/1686] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:04 2022] POST /identity/v3/users => generated 297 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:04.420703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:04.447545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19e3f0-3f01-443b-9709-4132f33c4e5e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:04.458598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df602f-ca29-45b8-99fe-6ca1efa72421 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:04.459406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:04.460083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.460439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.460716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.461451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:04.465803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:04.474520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:04.475375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.475671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.475932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] PATH_INFO: `/v3/users/fc12a129e9994df38f1422ca58aa3305` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.478797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc12a129e9994df38f1422ca58aa3305)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:04.481478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:04.489673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 831/1687] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:04.491095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:04.510955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4e99e-9b9e-4f00-a4cb-1964c6c1904e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:04.514535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:04.528967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:04.529892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.530205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.530483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] PATH_INFO: `/v3/projects/9cd0ac507a0b43feb55e0e37d63ec9ed/users/cf9e683e704947928214d7202d18403b/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.578950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd0ac507a0b43feb55e0e37d63ec9ed, user_id=cf9e683e704947928214d7202d18403b, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:04.584847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:04.596882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc12a129e9994df38f1422ca58aa3305'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:04.621514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 832/1688] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:04 2022] PUT /identity/v3/projects/9cd0ac507a0b43feb55e0e37d63ec9ed/users/cf9e683e704947928214d7202d18403b/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:04.623080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:04.633543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc12a129e9994df38f1422ca58aa3305'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:04.636004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc12a129e9994df38f1422ca58aa3305'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:04.636634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc12a129e9994df38f1422ca58aa3305'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:04.656785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6ab01ae6-5f4f-4140-9fcb-5f99655471dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc12a129e9994df38f1422ca58aa3305'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:04.686701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 857/1689] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:04 2022] DELETE /identity/v3/users/fc12a129e9994df38f1422ca58aa3305 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:04.693565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.694704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.695159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.721995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:04.724147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:04.812369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb4d2-aeb6-4ffc-bc26-430a8275ce10 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:04.857074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 858/1690] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:04.872339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:04.912767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:04.913744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.914158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.914505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.915480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:04.917287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:04.936224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 833/1691] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:04.936954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:04.938418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:04.967179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa1de3-33dd-4232-b464-a7404b504385 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:04.971308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:04.973625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:04.984050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62bd19-7b5c-4c78-bd6d-7001829c9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:04.984966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bd19-7b5c-4c78-bd6d-7001829c9e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:04.985251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bd19-7b5c-4c78-bd6d-7001829c9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:04.985530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bd19-7b5c-4c78-bd6d-7001829c9e9a admin admin] PATH_INFO: `/v3/projects/9cd0ac507a0b43feb55e0e37d63ec9ed/users/cf9e683e704947928214d7202d18403b/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:04.992176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62bd19-7b5c-4c78-bd6d-7001829c9e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd0ac507a0b43feb55e0e37d63ec9ed, user_id=cf9e683e704947928214d7202d18403b, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:04.997312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62bd19-7b5c-4c78-bd6d-7001829c9e9a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:05.033141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 859/1692] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:04 2022] PUT /identity/v3/projects/9cd0ac507a0b43feb55e0e37d63ec9ed/users/cf9e683e704947928214d7202d18403b/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:05.034988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:05.035302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:05.035570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:05.091513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] MFA Rules not processed for user `cf9e683e704947928214d7202d18403b`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:05.093305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:05.141839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2179b-d2c7-4e1a-8fb4-db33d7b82c56 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:05.242796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 860/1693] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:05.257935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:05.259991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:05.269452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:05.272523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:05.273888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:05.274180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:05.274463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:05.390864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa42eb-949c-4fb4-9815-2dcef0197e99 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:05.400854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:05.401940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:05.402440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:05.403251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:05.424277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:05.426226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:05.427510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:05.429202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:05.456029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 834/1694] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:05.460934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 861/1695] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:05.607752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:05.626414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14ec6-e64c-4b88-b62d-c716a7aed0ce service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:05.634234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:05.635058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:05.635214 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:05.635494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:05.638618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:05.733866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:05.796866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:05.802619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:05.827449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 835/1696] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:07.659346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:07.661891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:07.694768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bff98-dc7e-49c3-a221-ad27f7d50375 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:07.711936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:07.714724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:07.715413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:07.715997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] PATH_INFO: `/v3/projects/2b5c69d54af249e692d5e02c8adcd50f` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:07.718182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5c69d54af249e692d5e02c8adcd50f)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:07.721739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:07.931625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5c69d54af249e692d5e02c8adcd50f', 'request_id': 'req-a2ea37cf-9112-4882-be6c-e0ee7d081c96'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:07.951268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5c69d54af249e692d5e02c8adcd50f', 'request_id': 'req-a2ea37cf-9112-4882-be6c-e0ee7d081c96'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:07.974933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5c69d54af249e692d5e02c8adcd50f', 'request_id': 'req-a2ea37cf-9112-4882-be6c-e0ee7d081c96'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.024467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] The token cache is being invalidate because project 2b5c69d54af249e692d5e02c8adcd50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:08.024779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.032652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a2ea37cf-9112-4882-be6c-e0ee7d081c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.042791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 862/1697] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:07 2022] DELETE /identity/v3/projects/2b5c69d54af249e692d5e02c8adcd50f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:08.044085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:08.076580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97e2f9-6f2e-4d3d-a701-e6a2079cac2c service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:08.226493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:08.226939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:08.227230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:08.308815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] MFA Rules not processed for user `62374595979246448444c17ee227a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:08.310363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:08.370914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:08.372170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:08.372809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:08.373310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] PATH_INFO: `/v3/users/288422b03c1d44b5bf7a7dbbe491ef74` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:08.374915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=288422b03c1d44b5bf7a7dbbe491ef74)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:08.377130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:08.469772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288422b03c1d44b5bf7a7dbbe491ef74'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.495563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288422b03c1d44b5bf7a7dbbe491ef74'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.496299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288422b03c1d44b5bf7a7dbbe491ef74'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.496995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288422b03c1d44b5bf7a7dbbe491ef74'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.501459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 863/1698] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:08.503122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:08.505369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:08.509563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e5d57b3-2b89-4c08-a9d2-6bda42a81b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288422b03c1d44b5bf7a7dbbe491ef74'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.539422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 836/1699] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:08 2022] DELETE /identity/v3/users/288422b03c1d44b5bf7a7dbbe491ef74 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:08.540948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:08.541306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:08.541657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:08.578109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec06e54-07dd-4108-8d33-fcc833dd03d6 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:08.587449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] MFA Rules not processed for user `62374595979246448444c17ee227a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:08.590083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:08.616003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:08.742428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:08.745993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:08.752051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:08.761058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:08.763711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] PATH_INFO: `/v3/users/3a73a02c00554378a981d0503bd717a4` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:08.768773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a73a02c00554378a981d0503bd717a4)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:08.776834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:08.797545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 837/1700] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:08.813008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:08.816422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:08.928125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a73a02c00554378a981d0503bd717a4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.960059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a73a02c00554378a981d0503bd717a4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.961015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a73a02c00554378a981d0503bd717a4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.961935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a73a02c00554378a981d0503bd717a4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:08.973382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b3aa09b5-3032-47d3-b948-79b13ef3f845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a73a02c00554378a981d0503bd717a4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:09.015759 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 864/1701] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:08 2022] DELETE /identity/v3/users/3a73a02c00554378a981d0503bd717a4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:09.020870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:09.021244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:09.021627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:09.070445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:09.074280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:09.081762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be444bd5-c83e-4ed2-b1a0-8149b62822f7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:09.272735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 865/1702] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:09.273770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:09.277474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:09.315796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dc539-e736-40c2-87e2-b4e63717d82c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:09.338516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:09.340089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:09.340934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:09.341431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] PATH_INFO: `/v3/projects/57501975468e4c569850b8bc85fc659a` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:09.343304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57501975468e4c569850b8bc85fc659a)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:09.345989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:09.370756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17311c29-8fce-460b-8b6d-1bbd4bc88eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:09.372133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311c29-8fce-460b-8b6d-1bbd4bc88eaf service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:09.372877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311c29-8fce-460b-8b6d-1bbd4bc88eaf service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:09.373595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17311c29-8fce-460b-8b6d-1bbd4bc88eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:09.379735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-17311c29-8fce-460b-8b6d-1bbd4bc88eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:09.452088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:09.470731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57501975468e4c569850b8bc85fc659a', 'request_id': 'req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:09.496235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57501975468e4c569850b8bc85fc659a', 'request_id': 'req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:09.508639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57501975468e4c569850b8bc85fc659a', 'request_id': 'req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:09.538107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] The token cache is being invalidate because project 57501975468e4c569850b8bc85fc659a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:09.538773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:09.540095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:09.543762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 866/1703] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:09 2022] DELETE /identity/v3/projects/57501975468e4c569850b8bc85fc659a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:09.546134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:09.547996 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:09.601838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311c29-8fce-460b-8b6d-1bbd4bc88eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:09.603570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17311c29-8fce-460b-8b6d-1bbd4bc88eaf service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:09.661290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 838/1704] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:09.667587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f35d1-1f90-4c3f-9598-ae47228d6ea1 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:09.667587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f35d1-1f90-4c3f-9598-ae47228d6ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:09.667851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f35d1-1f90-4c3f-9598-ae47228d6ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:09.751141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d62f35d1-1f90-4c3f-9598-ae47228d6ea1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:09.752425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d62f35d1-1f90-4c3f-9598-ae47228d6ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:09.770178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94b90a-ec16-4d23-a8ac-fed77128f5a0 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:09.790338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b76734-fefa-4b5e-b8cf-63c1ac4a1389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:09.799178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76734-fefa-4b5e-b8cf-63c1ac4a1389 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:09.800579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76734-fefa-4b5e-b8cf-63c1ac4a1389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:09.802165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76734-fefa-4b5e-b8cf-63c1ac4a1389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:09.809299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f0b76734-fefa-4b5e-b8cf-63c1ac4a1389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:09.914058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:10.008905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b76734-fefa-4b5e-b8cf-63c1ac4a1389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.011192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b76734-fefa-4b5e-b8cf-63c1ac4a1389 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:10.030409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 867/1705] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:10.032541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 839/1706] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:10.040897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ba7d1-5b05-4c8c-beb8-b18baf69d52e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.040897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ba7d1-5b05-4c8c-beb8-b18baf69d52e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.041153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ba7d1-5b05-4c8c-beb8-b18baf69d52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.075718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-077ba7d1-5b05-4c8c-beb8-b18baf69d52e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:10.078587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-077ba7d1-5b05-4c8c-beb8-b18baf69d52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:10.091245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 868/1707] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:10.095669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f35d1-1f90-4c3f-9598-ae47228d6ea1 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.107127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f35d1-1f90-4c3f-9598-ae47228d6ea1 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:10.116707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:10.118068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.118663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.119367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.120798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:10.121382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.123454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:10.146302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 840/1708] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:10.149910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ba7d1-5b05-4c8c-beb8-b18baf69d52e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.168729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ba7d1-5b05-4c8c-beb8-b18baf69d52e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:10.177226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:10.178436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.178788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.179078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.179802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.181798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:10.271061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 869/1709] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:10 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:10.274954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.290078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dab111-fd10-4b0e-a4f9-92508a74db9b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:10.363924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:10.364627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.364914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.365480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.366199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.368348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:10.410049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 841/1710] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:10 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:10.414044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.439461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f842c-e63e-4bcc-83f4-2dd90488a920 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:10.452074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:10.453104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.453626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.454014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.454897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.464268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:10.491495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 870/1711] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:10.492568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.506826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7e86d-b15c-4eba-ac44-8e206e967d25 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:10.525521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38960-05c9-475c-be3b-d10636487a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:10.526189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38960-05c9-475c-be3b-d10636487a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.526489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38960-05c9-475c-be3b-d10636487a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.526769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38960-05c9-475c-be3b-d10636487a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.527510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e38960-05c9-475c-be3b-d10636487a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.529148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e38960-05c9-475c-be3b-d10636487a79 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:10.558911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.573658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 842/1712] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:10.591059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf38189-8570-4c3b-8ed8-d6e4f38226ee admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:10.602470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed4e16-27b3-419f-8770-c0700e571414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:10.603779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed4e16-27b3-419f-8770-c0700e571414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.604503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed4e16-27b3-419f-8770-c0700e571414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.605142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed4e16-27b3-419f-8770-c0700e571414 admin admin] PATH_INFO: `/v3/projects/0d8db082b1f5475ab205dd6ed6df1ae0/users/046a5bffd8ed49cd8552ffec08c2a6f2/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.639207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed4e16-27b3-419f-8770-c0700e571414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8db082b1f5475ab205dd6ed6df1ae0, user_id=046a5bffd8ed49cd8552ffec08c2a6f2, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.648809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed4e16-27b3-419f-8770-c0700e571414 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:10.678943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 871/1713] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:10 2022] PUT /identity/v3/projects/0d8db082b1f5475ab205dd6ed6df1ae0/users/046a5bffd8ed49cd8552ffec08c2a6f2/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:10.697127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c3335-1f35-4556-938e-48d957929c31 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.697759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c3335-1f35-4556-938e-48d957929c31 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.698709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c3335-1f35-4556-938e-48d957929c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.717442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639c95-8e25-4395-a25c-644433586662 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.717727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639c95-8e25-4395-a25c-644433586662 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.718181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b639c95-8e25-4395-a25c-644433586662 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.720325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 872/1714] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 30 10:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:22:10.740353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.740642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.740923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.750863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3a9c3335-1f35-4556-938e-48d957929c31 None None] MFA Rules not processed for user `046a5bffd8ed49cd8552ffec08c2a6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:10.752389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3a9c3335-1f35-4556-938e-48d957929c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:10.777946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] MFA Rules not processed for user `c11a44c395ae45fcba4e0c0fe08695c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:10.779240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:10.790151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:10.896265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 843/1715] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:10.900390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c3335-1f35-4556-938e-48d957929c31 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.910635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 873/1716] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:22:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:10.922054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:10.924240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:10.952865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7f967-fee6-487e-8cff-a11f317923ba None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:10.968649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:10.969707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:10.971283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:10.971985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:10.986086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:10.990324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:10.993376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:11.025038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 874/1717] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:11.074241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c3335-1f35-4556-938e-48d957929c31 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:11.081200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:11.082130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.082634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.083118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:11.084007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:11.086164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:11.138537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 844/1718] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:10 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:11.144122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:11.159989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de1e91-b26f-4ccc-be4b-b3382e6db9da service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:11.253988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a125eb-d6c8-4848-9219-e30fd6a93152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:11.256059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a125eb-d6c8-4848-9219-e30fd6a93152 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.257444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a125eb-d6c8-4848-9219-e30fd6a93152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.262218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a125eb-d6c8-4848-9219-e30fd6a93152 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:11.263858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a125eb-d6c8-4848-9219-e30fd6a93152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:11.270973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a125eb-d6c8-4848-9219-e30fd6a93152 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:11.317673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 875/1719] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:11 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:11.327585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:11.357572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391f8b1-6059-419c-ba54-91dd898bf0c9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:11.371650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfce013-2c5a-4e57-8b34-51e9eaf6ab6d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.371954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfce013-2c5a-4e57-8b34-51e9eaf6ab6d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.372235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfce013-2c5a-4e57-8b34-51e9eaf6ab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:11.404891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:11.406807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.407516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.410512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:11.415895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:11.421131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:11.474909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 845/1720] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:11.478234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:11.489508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-adfce013-2c5a-4e57-8b34-51e9eaf6ab6d None None] MFA Rules not processed for user `e7f3274a762a4e1c8ae1474ffcbe912d`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:11.499184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-adfce013-2c5a-4e57-8b34-51e9eaf6ab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:11.519383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8ca8-8672-4470-91d2-2c5c5429416a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:11.539963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:11.543897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.544619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.545098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] PATH_INFO: `/v3/projects/1e527b561ea4448fb84a8bad35a684e6/users/91b268c85425492b9b450f2e6117188a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:11.573664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e527b561ea4448fb84a8bad35a684e6, user_id=91b268c85425492b9b450f2e6117188a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:11.577295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:11.620050 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 846/1721] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:11 2022] PUT /identity/v3/projects/1e527b561ea4448fb84a8bad35a684e6/users/91b268c85425492b9b450f2e6117188a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:11.622082 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:11.682630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 876/1722] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:11.693043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.693437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.693842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:11.742893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] MFA Rules not processed for user `e7f3274a762a4e1c8ae1474ffcbe912d`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:11.748318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:11.778445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:11.829673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 877/1723] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:11.842640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:11.844386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:11.879229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e09822-bdf7-40c6-9f7e-9f386e5066b4 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:11.912930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4835f-000c-42c5-ac84-88322d13a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:11.920911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4835f-000c-42c5-ac84-88322d13a7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.921331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4835f-000c-42c5-ac84-88322d13a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.921498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4835f-000c-42c5-ac84-88322d13a7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:11.922284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4835f-000c-42c5-ac84-88322d13a7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:11.931400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4835f-000c-42c5-ac84-88322d13a7ae admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:11.976480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 847/1724] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:11.983140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:11.983469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:11.983754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:12.047717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba09ab9-cd6d-455f-8c3f-1519bd8cae59 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:12.066974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] MFA Rules not processed for user `ecf6ed97c0eb4db68cf951044ce9ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:12.068216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:12.069154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:12.069850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:12.070139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:12.070421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:12.097544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:12.099260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:12.122220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 878/1725] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:12.123031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:12.148234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fff60-5fb1-4d10-96e4-6a45adf46390 service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:12.154608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce68a0-08bb-404f-a971-d3f067eda766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:12.156014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce68a0-08bb-404f-a971-d3f067eda766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:12.156378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce68a0-08bb-404f-a971-d3f067eda766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:12.156723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce68a0-08bb-404f-a971-d3f067eda766 admin admin] PATH_INFO: `/v3/projects/1e527b561ea4448fb84a8bad35a684e6/users/91b268c85425492b9b450f2e6117188a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:12.159150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce68a0-08bb-404f-a971-d3f067eda766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e527b561ea4448fb84a8bad35a684e6, user_id=91b268c85425492b9b450f2e6117188a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:12.161950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce68a0-08bb-404f-a971-d3f067eda766 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:12.195702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 879/1726] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:12 2022] PUT /identity/v3/projects/1e527b561ea4448fb84a8bad35a684e6/users/91b268c85425492b9b450f2e6117188a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:12.207226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022cf3-b5aa-4554-8060-e5eef47f082f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:12.207757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022cf3-b5aa-4554-8060-e5eef47f082f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:12.208090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022cf3-b5aa-4554-8060-e5eef47f082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:12.359774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6c022cf3-b5aa-4554-8060-e5eef47f082f None None] MFA Rules not processed for user `91b268c85425492b9b450f2e6117188a`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:12.361091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6c022cf3-b5aa-4554-8060-e5eef47f082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:12.437456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 848/1727] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:12.443015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:12.449108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:12.507803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777aa80-5dc0-46ef-90f2-e87c61dec81b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:12.524891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:12.599227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 880/1728] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:12.601234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa756f-b703-4288-958b-af5a9595624d None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:12.601911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa756f-b703-4288-958b-af5a9595624d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:12.602623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa756f-b703-4288-958b-af5a9595624d None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:12.611122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 881/1729] 10.222.0.44 () {54 vars in 960 bytes} [Thu Jun 30 10:22:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:22:12.613282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa756f-b703-4288-958b-af5a9595624d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:12.615700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f0aa756f-b703-4288-958b-af5a9595624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:12.671977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:12.702766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:12.704025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:12.704025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:12.704234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] PATH_INFO: `/v3/projects/a8ac9824948a4304a818d990be8be095` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:12.705539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ac9824948a4304a818d990be8be095)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:12.708679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:12.791604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa756f-b703-4288-958b-af5a9595624d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:12.808989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:12.810817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:12.811241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:12.812266 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:12.832821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ac9824948a4304a818d990be8be095', 'request_id': 'req-1acfbd36-a6e0-4f9a-afe6-bafda863f007'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:12.880991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ac9824948a4304a818d990be8be095', 'request_id': 'req-1acfbd36-a6e0-4f9a-afe6-bafda863f007'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:12.916206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ac9824948a4304a818d990be8be095', 'request_id': 'req-1acfbd36-a6e0-4f9a-afe6-bafda863f007'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:12.950371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] The token cache is being invalidate because project a8ac9824948a4304a818d990be8be095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:12.951576 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:12.955144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1acfbd36-a6e0-4f9a-afe6-bafda863f007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:12.964829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 849/1730] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:12 2022] DELETE /identity/v3/projects/a8ac9824948a4304a818d990be8be095 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:12.969909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4cbb-548f-40ef-a507-673e205d0e2b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:12.970259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4cbb-548f-40ef-a507-673e205d0e2b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:12.973680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4cbb-548f-40ef-a507-673e205d0e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:13.004847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:13.007198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:13.037252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-164b4cbb-548f-40ef-a507-673e205d0e2b None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:13.039778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 882/1731] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:13.051930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:13.067672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-164b4cbb-548f-40ef-a507-673e205d0e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:13.070379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:13.328645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1051b6d-b47c-468c-98fb-b3389c0a3c3d service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:13.349733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 850/1732] 10.222.0.44 () {58 vars in 1057 bytes} [Thu Jun 30 10:22:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:13.364364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b579c3-62b5-467d-a5da-c10c78983510 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:13.364696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b579c3-62b5-467d-a5da-c10c78983510 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:13.366420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b579c3-62b5-467d-a5da-c10c78983510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:13.483547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-94b579c3-62b5-467d-a5da-c10c78983510 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:13.491706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-94b579c3-62b5-467d-a5da-c10c78983510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:13.610305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:13.612903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5c720-2403-4f71-afe4-864082b5eea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:13.613609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5c720-2403-4f71-afe4-864082b5eea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:13.614019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5c720-2403-4f71-afe4-864082b5eea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:13.614331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5c720-2403-4f71-afe4-864082b5eea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:13.631807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-31a5c720-2403-4f71-afe4-864082b5eea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:13.739836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:13.770415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 851/1733] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:13.770415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b579c3-62b5-467d-a5da-c10c78983510 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:13.843209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b579c3-62b5-467d-a5da-c10c78983510 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:13.851405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5c720-2403-4f71-afe4-864082b5eea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:13.854146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5c720-2403-4f71-afe4-864082b5eea7 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:13.868520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffd870-879c-4e8c-98ff-feee99e4119c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:13.868778 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd870-879c-4e8c-98ff-feee99e4119c service placement] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:13.868931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd870-879c-4e8c-98ff-feee99e4119c service placement] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:13.869217 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffd870-879c-4e8c-98ff-feee99e4119c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:13.879957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 883/1734] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:13.881767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246f2f-d8cf-4081-8de6-e8e0907358de None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:13.882373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246f2f-d8cf-4081-8de6-e8e0907358de None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:13.882917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd246f2f-d8cf-4081-8de6-e8e0907358de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:13.891659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d9ffd870-879c-4e8c-98ff-feee99e4119c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:13.966567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd870-879c-4e8c-98ff-feee99e4119c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:13.975773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffd870-879c-4e8c-98ff-feee99e4119c service placement] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:13.998453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-cd246f2f-d8cf-4081-8de6-e8e0907358de None None] MFA Rules not processed for user `4c65e6495f7e43408c26706c89f61ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:14.000602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cd246f2f-d8cf-4081-8de6-e8e0907358de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:14.006967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 852/1735] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:14.016457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081dbce-fedc-488b-816a-87cd5da7929c None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:14.023982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081dbce-fedc-488b-816a-87cd5da7929c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:14.025072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081dbce-fedc-488b-816a-87cd5da7929c None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:14.029547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 853/1736] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 30 10:22:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:22:14.038406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ba37-176e-4811-a9af-d3546a582828 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:14.038953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ba37-176e-4811-a9af-d3546a582828 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:14.040579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ba37-176e-4811-a9af-d3546a582828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:14.126129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c174ba37-176e-4811-a9af-d3546a582828 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:14.127384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c174ba37-176e-4811-a9af-d3546a582828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:14.177357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 854/1737] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:14.182542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfb438-33c1-4837-b050-a411bdcd06bb None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:14.186634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfb438-33c1-4837-b050-a411bdcd06bb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:14.187143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfb438-33c1-4837-b050-a411bdcd06bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:14.255246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 884/1738] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:14.258102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246f2f-d8cf-4081-8de6-e8e0907358de None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:14.279918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd246f2f-d8cf-4081-8de6-e8e0907358de None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:14.281822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-25dfb438-33c1-4837-b050-a411bdcd06bb None None] MFA Rules not processed for user `c11a44c395ae45fcba4e0c0fe08695c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:14.283321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-25dfb438-33c1-4837-b050-a411bdcd06bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:14.295720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:14.296627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:14.303145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:14.303825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:14.305029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:14.305450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:14.307873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:14.332711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 885/1739] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:14.335292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:14.337161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:14.525263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 855/1740] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:22:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:14.527343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfb438-33c1-4837-b050-a411bdcd06bb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:14.568534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfb438-33c1-4837-b050-a411bdcd06bb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:14.581826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:14.582556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:14.583002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:14.583330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:14.585069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:14.597667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:14.600687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5aae8e-47bb-4d09-a0d9-61576d68827c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:14.626779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:14.628404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:14.628705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:14.631552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:14.667400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:14.669108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:14.693247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 856/1741] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:14 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:14.699920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:14.716524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:14.718062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 886/1742] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:14.719326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:14.726864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:14.774861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cd6f4-0a41-48e0-a3fd-2f969d86e9ae service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:14.891403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:14.980959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416006-83dc-4ac1-908c-1437318659a2 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:14.997186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:14.997879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:14.998749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:14.999122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:15.002734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:15.003227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:15.003602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:15.003602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:15.011248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:15.039888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:15.042748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:15.114013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 887/1743] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:15.115082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:15.302131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:15.310272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:15.315936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:15.364447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 857/1744] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:15.405700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033efdbd-bc76-4e93-a6a7-4964a7fd7f36 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:15.417855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:15.419195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:15.419669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:15.423649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:15.426056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:15.432975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:15.516513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 888/1745] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:15 2022] POST /identity/v3/users => generated 286 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:15.521121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:15.551376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6723-fe42-4818-869d-d2d74f3b6a59 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:15.564468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:15.565388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:15.565817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:15.566252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:15.567183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:15.569137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:15.610166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:15.611391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 858/1746] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:15.622862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a1095-2467-43b8-8da1-ad585d9d6341 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:15.643590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540e12-4fc9-48ad-a022-1757e5cf0870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:15.644954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540e12-4fc9-48ad-a022-1757e5cf0870 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:15.645869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540e12-4fc9-48ad-a022-1757e5cf0870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:15.649574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540e12-4fc9-48ad-a022-1757e5cf0870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:15.652334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540e12-4fc9-48ad-a022-1757e5cf0870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:15.657916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540e12-4fc9-48ad-a022-1757e5cf0870 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:15.686101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 889/1747] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:15.687968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:15.702469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424578-d233-4d16-81a9-34bb37e13865 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:15.718584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:15.719809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:15.720234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:15.720650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] PATH_INFO: `/v3/projects/d92052e82e814fdbae3d47202aa659e1/users/0d98f2283f644160a73cd6b9e5f5f9c3/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:15.773230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92052e82e814fdbae3d47202aa659e1, user_id=0d98f2283f644160a73cd6b9e5f5f9c3, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:15.776033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:15.827970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 859/1748] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:15 2022] PUT /identity/v3/projects/d92052e82e814fdbae3d47202aa659e1/users/0d98f2283f644160a73cd6b9e5f5f9c3/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:15.842929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:15.843258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:15.843494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:15.957144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] MFA Rules not processed for user `0d98f2283f644160a73cd6b9e5f5f9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:15.958635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:16.206443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 890/1749] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:16.217395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:16.411708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11e30-4d6d-467f-824a-421ac46a7b05 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:16.425006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac021e97-e7da-4871-82e3-313e501246b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:16.431209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021e97-e7da-4871-82e3-313e501246b1 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:16.431809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021e97-e7da-4871-82e3-313e501246b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:16.432274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac021e97-e7da-4871-82e3-313e501246b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:16.479380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac021e97-e7da-4871-82e3-313e501246b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:16.482974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac021e97-e7da-4871-82e3-313e501246b1 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:16.522905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:16.525205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:16.542774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 860/1750] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:16.802387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:16.873830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe5f5-f418-4326-91df-55ad29d46e80 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:16.899631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:16.900756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:16.901671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:16.902056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] PATH_INFO: `/v3/users/046a5bffd8ed49cd8552ffec08c2a6f2` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:16.911636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046a5bffd8ed49cd8552ffec08c2a6f2)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:16.913599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:17.111447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046a5bffd8ed49cd8552ffec08c2a6f2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:17.155575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046a5bffd8ed49cd8552ffec08c2a6f2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:17.156364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046a5bffd8ed49cd8552ffec08c2a6f2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:17.157012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046a5bffd8ed49cd8552ffec08c2a6f2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:17.186083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046a5bffd8ed49cd8552ffec08c2a6f2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:17.234617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 891/1751] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:16 2022] DELETE /identity/v3/users/046a5bffd8ed49cd8552ffec08c2a6f2 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:17.241609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39942-19b4-42fc-87a1-c9f10e63f605 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:17.242632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39942-19b4-42fc-87a1-c9f10e63f605 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:17.243203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39942-19b4-42fc-87a1-c9f10e63f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:17.302891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-64f39942-19b4-42fc-87a1-c9f10e63f605 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:17.309247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-64f39942-19b4-42fc-87a1-c9f10e63f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:17.476973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 861/1752] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:17.584040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:17.585774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:17.716636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c34f40-31eb-4ec9-865a-92a3185f6174 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:17.722717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6f6e1-6a9c-476c-9cc4-74b8a42c89c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:17.723615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f6e1-6a9c-476c-9cc4-74b8a42c89c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:17.724060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f6e1-6a9c-476c-9cc4-74b8a42c89c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:17.724550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f6e1-6a9c-476c-9cc4-74b8a42c89c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:17.766130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6f6e1-6a9c-476c-9cc4-74b8a42c89c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:17.767939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6f6e1-6a9c-476c-9cc4-74b8a42c89c7 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:17.810386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 892/1753] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:17.881045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:17.881387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:17.881792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:17.951976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] MFA Rules not processed for user `e7f3274a762a4e1c8ae1474ffcbe912d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:17.961511 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:18.256201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:18.364247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 862/1754] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:18.634720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:18.635317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:18.635483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:18.716826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:18.724411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:18.739948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:18.742053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:18.781842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54443427-13a3-49a1-b54e-37b9ed8d2ff1 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:18.799693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:18.803395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:18.806494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:18.808037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] PATH_INFO: `/v3/users/0d98f2283f644160a73cd6b9e5f5f9c3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:18.821792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d98f2283f644160a73cd6b9e5f5f9c3)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:18.831231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:19.008210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 893/1755] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:22:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:19.022401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d98f2283f644160a73cd6b9e5f5f9c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.043842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:19.047129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:19.081054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd910-66bd-429a-af99-21802c4ddf67 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:19.088557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:19.089741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:19.090808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:19.091294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] PATH_INFO: `/v3/users/bfffa95d81694117945a7794ac1cc847` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:19.093308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfffa95d81694117945a7794ac1cc847)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:19.097100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:19.100564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:19.107703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d98f2283f644160a73cd6b9e5f5f9c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.111894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d98f2283f644160a73cd6b9e5f5f9c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.113044 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d98f2283f644160a73cd6b9e5f5f9c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.157705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ab1610ee-4ba7-49c9-bda7-5d49390039f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d98f2283f644160a73cd6b9e5f5f9c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.212500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfffa95d81694117945a7794ac1cc847'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.225648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 863/1756] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:18 2022] DELETE /identity/v3/users/0d98f2283f644160a73cd6b9e5f5f9c3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:19.231138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfffa95d81694117945a7794ac1cc847'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.232021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384238-db79-44bf-9041-5361379279c9 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:19.232138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfffa95d81694117945a7794ac1cc847'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.232543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384238-db79-44bf-9041-5361379279c9 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:19.232969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384238-db79-44bf-9041-5361379279c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:19.233497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfffa95d81694117945a7794ac1cc847'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.244161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e091813d-4d5e-4919-a81f-a3cbe0390bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfffa95d81694117945a7794ac1cc847'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:19.270638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 894/1757] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:19 2022] DELETE /identity/v3/users/bfffa95d81694117945a7794ac1cc847 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:19.275299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:19.275656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:19.276958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:19.310673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-36384238-db79-44bf-9041-5361379279c9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:19.317025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-36384238-db79-44bf-9041-5361379279c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:19.334549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:19.335195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:19.507938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 864/1758] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:19.509170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384238-db79-44bf-9041-5361379279c9 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:19.514413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-36384238-db79-44bf-9041-5361379279c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:19.545053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 895/1759] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:19.569947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:19.571419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:19.757066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384238-db79-44bf-9041-5361379279c9 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:19.775564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5483a-b061-4fff-9947-32f0eb829061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:19.793044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc32a1-7fed-48ab-ab31-57da3ecd5943 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:19.797961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5483a-b061-4fff-9947-32f0eb829061 service swift] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:19.798260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5483a-b061-4fff-9947-32f0eb829061 service swift] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:19.798546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5483a-b061-4fff-9947-32f0eb829061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:19.813760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e1e5483a-b061-4fff-9947-32f0eb829061 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:19.822085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:19.824127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:19.825022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:19.825408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:19.831985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:19.849548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:19.850976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:19.881555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 896/1760] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:19.883181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:19.891593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:19.924794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687360-d253-4081-90e7-9fbe09ffaa3a service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:19.935623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:19.937195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:19.939016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:19.939016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:19.966498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:19.968329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:20.000256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 897/1761] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:20.014569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5483a-b061-4fff-9947-32f0eb829061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:20.017149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5483a-b061-4fff-9947-32f0eb829061 service swift] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:20.063269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 865/1762] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:22:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:22:20.456714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:20.462233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:20.492066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e9cd-ffb3-4c5c-bdc9-41ffd7aa6f92 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:20.495669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e9cd-ffb3-4c5c-bdc9-41ffd7aa6f92 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:20.496104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e9cd-ffb3-4c5c-bdc9-41ffd7aa6f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:20.545726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ce12c-a922-4f38-9328-5768c1c9fbd1 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:20.583196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d213e9cd-ffb3-4c5c-bdc9-41ffd7aa6f92 None None] MFA Rules not processed for user `ecf6ed97c0eb4db68cf951044ce9ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:20.584452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d213e9cd-ffb3-4c5c-bdc9-41ffd7aa6f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:20.602097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:20.603098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:20.604158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:20.604158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] PATH_INFO: `/v3/projects/0d8db082b1f5475ab205dd6ed6df1ae0` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:20.613536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8db082b1f5475ab205dd6ed6df1ae0)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:20.624270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:20.645226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:20.835153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8db082b1f5475ab205dd6ed6df1ae0', 'request_id': 'req-3ad9f9a6-b11d-4829-bab1-214dcd09f863'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:20.872473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8db082b1f5475ab205dd6ed6df1ae0', 'request_id': 'req-3ad9f9a6-b11d-4829-bab1-214dcd09f863'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:20.911155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8db082b1f5475ab205dd6ed6df1ae0', 'request_id': 'req-3ad9f9a6-b11d-4829-bab1-214dcd09f863'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:20.920940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 866/1763] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:20.989185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] The token cache is being invalidate because project 0d8db082b1f5475ab205dd6ed6df1ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:20.991211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:20.994337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3ad9f9a6-b11d-4829-bab1-214dcd09f863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:21.001446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 898/1764] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:20 2022] DELETE /identity/v3/projects/0d8db082b1f5475ab205dd6ed6df1ae0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:21.005548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e9cd-ffb3-4c5c-bdc9-41ffd7aa6f92 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:21.028731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e9cd-ffb3-4c5c-bdc9-41ffd7aa6f92 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:21.331468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:21.332458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:21.332745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:21.333025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] PATH_INFO: `/v3/users/91b268c85425492b9b450f2e6117188a` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:21.340583 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b268c85425492b9b450f2e6117188a)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:21.350232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:21.549252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b268c85425492b9b450f2e6117188a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:21.563869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:21.581242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b268c85425492b9b450f2e6117188a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:21.584172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b268c85425492b9b450f2e6117188a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:21.585932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b268c85425492b9b450f2e6117188a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:21.605857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b268c85425492b9b450f2e6117188a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:21.643150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 867/1765] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:21 2022] DELETE /identity/v3/users/91b268c85425492b9b450f2e6117188a => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:23.350465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879b0f-9ddc-4813-9b80-86fa519a8199 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:23.351544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879b0f-9ddc-4813-9b80-86fa519a8199 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:23.351979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86879b0f-9ddc-4813-9b80-86fa519a8199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:23.370460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:23.372064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:23.431694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-86879b0f-9ddc-4813-9b80-86fa519a8199 None None] MFA Rules not processed for user `4c65e6495f7e43408c26706c89f61ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:23.438870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-86879b0f-9ddc-4813-9b80-86fa519a8199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:23.624483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa86d5-66bc-4576-9934-84894175db05 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:23.655884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:23.657561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:23.657854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:23.658139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] PATH_INFO: `/v3/projects/2678a302ff274f4090642cbad0043619` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:23.668371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2678a302ff274f4090642cbad0043619)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:23.676118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:23.791200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 899/1766] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:23.927596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2678a302ff274f4090642cbad0043619', 'request_id': 'req-42a5812b-a2f6-46b6-b94d-c39e423d2b13'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:23.969453 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2678a302ff274f4090642cbad0043619', 'request_id': 'req-42a5812b-a2f6-46b6-b94d-c39e423d2b13'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.034877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2678a302ff274f4090642cbad0043619', 'request_id': 'req-42a5812b-a2f6-46b6-b94d-c39e423d2b13'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.074456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] The token cache is being invalidate because project 2678a302ff274f4090642cbad0043619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:24.076880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.078960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.085407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 868/1767] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:23 2022] DELETE /identity/v3/projects/2678a302ff274f4090642cbad0043619 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:24.090481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879b0f-9ddc-4813-9b80-86fa519a8199 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:24.113195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86879b0f-9ddc-4813-9b80-86fa519a8199 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:24.188603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:24.190250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:24.417917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:24.421109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5812b-a2f6-46b6-b94d-c39e423d2b13 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:24.424978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:24.428204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:24.428890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] PATH_INFO: `/v3/users/cf9e683e704947928214d7202d18403b` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:24.432947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:24.435664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:24.436226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:24.436667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] PATH_INFO: `/v3/projects/d92052e82e814fdbae3d47202aa659e1` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:24.439592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92052e82e814fdbae3d47202aa659e1)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:24.442100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:24.443919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9e683e704947928214d7202d18403b)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:24.444522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:24.449550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:24.602019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:24.609310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92052e82e814fdbae3d47202aa659e1', 'request_id': 'req-72148408-80dc-4468-9d7c-f1752c78919e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.631365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9e683e704947928214d7202d18403b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.662182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92052e82e814fdbae3d47202aa659e1', 'request_id': 'req-72148408-80dc-4468-9d7c-f1752c78919e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.678867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9e683e704947928214d7202d18403b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.685169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9e683e704947928214d7202d18403b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.687158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9e683e704947928214d7202d18403b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.700251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92052e82e814fdbae3d47202aa659e1', 'request_id': 'req-72148408-80dc-4468-9d7c-f1752c78919e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.722527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5fce08a0-7726-43a2-99d8-5f8bacf99e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9e683e704947928214d7202d18403b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.761082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 900/1768] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:24 2022] DELETE /identity/v3/users/cf9e683e704947928214d7202d18403b => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:24.769196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1a2b-6a42-4b81-9a71-003fe2b5f7bb None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:24.769813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1a2b-6a42-4b81-9a71-003fe2b5f7bb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:24.770254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1a2b-6a42-4b81-9a71-003fe2b5f7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:24.777386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] The token cache is being invalidate because project d92052e82e814fdbae3d47202aa659e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:24.781584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.788077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-72148408-80dc-4468-9d7c-f1752c78919e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:24.807754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 869/1769] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:24 2022] DELETE /identity/v3/projects/d92052e82e814fdbae3d47202aa659e1 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:24.810262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-39ba1a2b-6a42-4b81-9a71-003fe2b5f7bb None None] MFA Rules not processed for user `c11a44c395ae45fcba4e0c0fe08695c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:24.814043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-39ba1a2b-6a42-4b81-9a71-003fe2b5f7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:24.815948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:24.827379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:24.827990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:24.927580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:24.935472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:24.967076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 901/1770] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Jun 30 10:22:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:25.228127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 870/1771] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:25.238891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0ba0-3a43-4b08-a70c-ef5632b95e4f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:25.239641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0ba0-3a43-4b08-a70c-ef5632b95e4f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:25.240081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0ba0-3a43-4b08-a70c-ef5632b95e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:25.281029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e07b0ba0-3a43-4b08-a70c-ef5632b95e4f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:25.282292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e07b0ba0-3a43-4b08-a70c-ef5632b95e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:25.297663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:25.300638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:25.331525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 902/1772] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:25.332284 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0ba0-3a43-4b08-a70c-ef5632b95e4f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:25.334647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41bee-1b4c-4b3f-9d37-4911c35925a0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:25.348438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:25.348438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:25.348792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:25.354403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:25.365730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0ba0-3a43-4b08-a70c-ef5632b95e4f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:25.381524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:25.387735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:25.388817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:25.393361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:25.395302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:25.395844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:25.396628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:25.396983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:25.398789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:25.421999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 871/1773] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:25.440422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 903/1774] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:25.444724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:25.464759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c55760-f2a7-4ceb-91bb-88e56bf22df2 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:25.495821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:25.496524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:25.496801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:25.497085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:25.497813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:25.499881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:25.606305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:25.608242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:25.631894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 872/1775] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:25 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:25.635876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e687c1-6e88-4fc0-a39a-65f65aa8b029 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:25.638215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:25.997941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:26.011319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c0a1d-c85c-4ca9-8d67-e93d2471a1b1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:26.031950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:26.032835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:26.033242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:26.033623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:26.034459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:26.037060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:26.101127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 873/1776] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:25 2022] POST /identity/v3/users => generated 294 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:26.105229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:26.125151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8df2-3faa-4ddc-8865-21e2d6fc7b1d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:26.137947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:26.138959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:26.139616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:26.140096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:26.141588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:26.144164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:26.179095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 874/1777] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:26.183767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:26.220928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372bad9-1a14-4304-83c5-71412580d5d4 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:26.241227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:26.242646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:26.243265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:26.243811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:26.246294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:26.251427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:26.294631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 875/1778] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:26.295776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:26.338969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:26.340681 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:26.342224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688cd6-810b-4ed6-ba57-0b6245f7ba47 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:26.346462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:26.349375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] PATH_INFO: `/v3/projects/1e527b561ea4448fb84a8bad35a684e6` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:26.358772 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e527b561ea4448fb84a8bad35a684e6)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:26.364563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc592-47fa-4dbf-8ad0-a35c9c96d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:26.365480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc592-47fa-4dbf-8ad0-a35c9c96d03d admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:26.365761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc592-47fa-4dbf-8ad0-a35c9c96d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:26.366036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc592-47fa-4dbf-8ad0-a35c9c96d03d admin admin] PATH_INFO: `/v3/projects/fdd14b7890b0406c9d42db85cafd848e/users/d3895de499034f2f919263e6485fd4e4/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:26.366889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:26.437307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbc592-47fa-4dbf-8ad0-a35c9c96d03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd14b7890b0406c9d42db85cafd848e, user_id=d3895de499034f2f919263e6485fd4e4, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:26.440846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbc592-47fa-4dbf-8ad0-a35c9c96d03d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:26.487889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 876/1779] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:26 2022] PUT /identity/v3/projects/fdd14b7890b0406c9d42db85cafd848e/users/d3895de499034f2f919263e6485fd4e4/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:26.499428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:26.500031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:26.500465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:26.568064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] MFA Rules not processed for user `d3895de499034f2f919263e6485fd4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:26.569673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:26.621027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e527b561ea4448fb84a8bad35a684e6', 'request_id': 'req-349e9861-4d03-429e-ac11-9d4c18d26cca'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:26.630922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:26.646646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e527b561ea4448fb84a8bad35a684e6', 'request_id': 'req-349e9861-4d03-429e-ac11-9d4c18d26cca'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:26.660389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e527b561ea4448fb84a8bad35a684e6', 'request_id': 'req-349e9861-4d03-429e-ac11-9d4c18d26cca'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:26.690981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] The token cache is being invalidate because project 1e527b561ea4448fb84a8bad35a684e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:26.692022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:26.693103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-349e9861-4d03-429e-ac11-9d4c18d26cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:26.695542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 904/1780] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:25 2022] DELETE /identity/v3/projects/1e527b561ea4448fb84a8bad35a684e6 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:26.709373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01509823-a2a6-44f6-abdf-7e6aa33dec0c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:26.709594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01509823-a2a6-44f6-abdf-7e6aa33dec0c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:26.709888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01509823-a2a6-44f6-abdf-7e6aa33dec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:26.744022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-01509823-a2a6-44f6-abdf-7e6aa33dec0c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:26.747453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-01509823-a2a6-44f6-abdf-7e6aa33dec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:26.908711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 877/1781] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:26.913847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:26.915307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:27.016744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 905/1782] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:27.023744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f7aa8-1ffc-452e-96a1-d20312d45986 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:27.024210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f7aa8-1ffc-452e-96a1-d20312d45986 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:27.028774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f7aa8-1ffc-452e-96a1-d20312d45986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:27.145035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-909f7aa8-1ffc-452e-96a1-d20312d45986 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:27.153838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-909f7aa8-1ffc-452e-96a1-d20312d45986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:27.160521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27ceb8-4b76-41d0-ae38-3f38cd7ac77a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:27.183820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:27.185077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:27.185777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:27.186304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:27.188552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:27.204906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:27.205142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 906/1783] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:27.208557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f7aa8-1ffc-452e-96a1-d20312d45986 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:27.284582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f7aa8-1ffc-452e-96a1-d20312d45986 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:27.298882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 878/1784] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:26 2022] POST /identity/v3/projects => generated 387 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:27.302815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:27.434993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:27.523512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:27.524570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:27.525279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:27.525775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:27.529976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:27.530584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:27.535888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:27.577107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 907/1785] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:27.579828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:27.616715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4bc34-bf89-4844-a628-0f969e71f5e9 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:27.639054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:27.640734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:27.641246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:27.641742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:27.642999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:27.649362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:27.737777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 908/1786] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:27 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:27.739840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:27.772562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78a01c-f092-4096-9dbf-d3ad57185fb3 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:27.969448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:27.971882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:27.972288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:27.972616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:27.973341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:27.976627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:27.985287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:28.026677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 879/1787] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:27 2022] POST /identity/v3/users => generated 300 bytes in 727 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:28.027753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:28.039711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367b3d-1d43-4530-b737-1c6fa377d861 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.046242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.047934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.049338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.049634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.051099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.053598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.054376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f827c-92fd-432c-9ccf-80a4a68cf0bb admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.070578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 880/1788] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:28.071813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:28.080202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.080924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.081213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.081498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.084206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569edcb-9312-47b7-8a58-3ad5e3a590b1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.085549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.087653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.089243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.090160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.090443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.090732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] PATH_INFO: `/v3/projects/8a48e9e1dce24aa1be79db241c85c00f/users/d32310d6e44748dab5b2021c0f048d5c/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.110509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a48e9e1dce24aa1be79db241c85c00f, user_id=d32310d6e44748dab5b2021c0f048d5c, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.113461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.142319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 909/1789] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:27 2022] POST /identity/v3/users => generated 288 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:28.144657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 881/1790] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:28 2022] PUT /identity/v3/projects/8a48e9e1dce24aa1be79db241c85c00f/users/d32310d6e44748dab5b2021c0f048d5c/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:28.146519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:28.154498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:28.180103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7896566-8193-4c72-9d3b-d565e7c30930 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.377000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.377947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.378424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.379120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.380063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.381870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.408689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 910/1791] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:28.409909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:28.436052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead08175-330d-4137-bcc9-09e4d018b24e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.452891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.453845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.454151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.454489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.455269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.457209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.504487 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 911/1792] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:28.505493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:28.506192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c080e7-45a7-44e7-b3e4-e52d90a8f88b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.514125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.515178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.515704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.516370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.518199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.520676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.525711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfa9c-ef18-4b6d-a291-7a07611bc2df admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.540232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e07d-39d6-4af3-8b8c-4c00f68fea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.541549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e07d-39d6-4af3-8b8c-4c00f68fea12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.542144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e07d-39d6-4af3-8b8c-4c00f68fea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.542594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e07d-39d6-4af3-8b8c-4c00f68fea12 admin admin] PATH_INFO: `/v3/projects/714a6e841c1742c2b64b1ffb73c8010a/users/f9f06fd8e2454876be43060c7b7330b9/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.567411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 882/1793] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:28.570470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:28.608711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e07d-39d6-4af3-8b8c-4c00f68fea12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714a6e841c1742c2b64b1ffb73c8010a, user_id=f9f06fd8e2454876be43060c7b7330b9, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.616290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e07d-39d6-4af3-8b8c-4c00f68fea12 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.621702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd34b5-7019-4046-9f35-2fb17878aeaf admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:28.638935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364ed0-5af1-44b3-8206-c0f457b796f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:28.643147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364ed0-5af1-44b3-8206-c0f457b796f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.649056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364ed0-5af1-44b3-8206-c0f457b796f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.649645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 912/1794] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:28 2022] PUT /identity/v3/projects/714a6e841c1742c2b64b1ffb73c8010a/users/f9f06fd8e2454876be43060c7b7330b9/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:28.662208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364ed0-5af1-44b3-8206-c0f457b796f1 admin admin] PATH_INFO: `/v3/projects/8a48e9e1dce24aa1be79db241c85c00f/users/d32310d6e44748dab5b2021c0f048d5c/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.663232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf9301-b501-4d3c-bbf2-bd011ffeb175 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.663525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf9301-b501-4d3c-bbf2-bd011ffeb175 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.663931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf9301-b501-4d3c-bbf2-bd011ffeb175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.670463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364ed0-5af1-44b3-8206-c0f457b796f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a48e9e1dce24aa1be79db241c85c00f, user_id=d32310d6e44748dab5b2021c0f048d5c, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:28.674882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364ed0-5af1-44b3-8206-c0f457b796f1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:28.697926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:28.730123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 883/1795] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:28 2022] PUT /identity/v3/projects/8a48e9e1dce24aa1be79db241c85c00f/users/d32310d6e44748dab5b2021c0f048d5c/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:28.759127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:28.760624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:28.761161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:28.818561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-00bf9301-b501-4d3c-bbf2-bd011ffeb175 None None] MFA Rules not processed for user `f9f06fd8e2454876be43060c7b7330b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:28.827452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-00bf9301-b501-4d3c-bbf2-bd011ffeb175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:28.882853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] MFA Rules not processed for user `d32310d6e44748dab5b2021c0f048d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:28.884752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:29.079058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 884/1796] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:29.092156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:29.094894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:29.105805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 913/1797] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:29.107630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf9301-b501-4d3c-bbf2-bd011ffeb175 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:29.239521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:29.277619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b484bf-d907-48ee-b29c-9f3faca285c5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:29.296164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:29.296867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:29.301469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:29.301794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:29.339093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:29.348875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:29.403008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf9301-b501-4d3c-bbf2-bd011ffeb175 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:29.417520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:29.418253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:29.418608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:29.418929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:29.420081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 885/1798] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:29.427535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:29.429497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:29.453717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:29.459759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:29.518629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 914/1799] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:29 2022] POST /identity/v3/projects => generated 375 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:29.521245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:29.537558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834631-240e-4f5d-8ceb-6c42f9e0c609 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:29.704099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba346f2-6889-4487-8c32-d6ddf0b55f2c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:29.718351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:29.719940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:29.720954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:29.721682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] PATH_INFO: `/v3/projects/9cd0ac507a0b43feb55e0e37d63ec9ed` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:29.723569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd0ac507a0b43feb55e0e37d63ec9ed)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:29.728927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:29.729626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:29.729910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:29.730188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:29.731178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:29.732851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:29.747127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:29.791777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:29.835407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd0ac507a0b43feb55e0e37d63ec9ed', 'request_id': 'req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:29.839737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 915/1800] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:29 2022] POST /identity/v3/users => generated 294 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:29.839737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:29.857842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd0ac507a0b43feb55e0e37d63ec9ed', 'request_id': 'req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:29.881851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd0ac507a0b43feb55e0e37d63ec9ed', 'request_id': 'req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:29.915345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] The token cache is being invalidate because project 9cd0ac507a0b43feb55e0e37d63ec9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:29.916627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:29.928088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:29.937671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 886/1801] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:29 2022] DELETE /identity/v3/projects/9cd0ac507a0b43feb55e0e37d63ec9ed => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:29.937671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:29.938582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:29.940322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e355f-5cdf-451a-a96b-a9f7c7f1f659 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:30.155883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95279-aba6-4a6a-a614-6cd99c8e5b2e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:30.177850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d6c0-eaab-49e4-8237-6acace6b50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:30.178798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d6c0-eaab-49e4-8237-6acace6b50df admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.179539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d6c0-eaab-49e4-8237-6acace6b50df admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.179936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d6c0-eaab-49e4-8237-6acace6b50df admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.180809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d6c0-eaab-49e4-8237-6acace6b50df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:30.182640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d6c0-eaab-49e4-8237-6acace6b50df admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:30.226167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 887/1802] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:30.226167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224635d9-e944-4ad0-b3dc-c581e3eca5e7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.226167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224635d9-e944-4ad0-b3dc-c581e3eca5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.226167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224635d9-e944-4ad0-b3dc-c581e3eca5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.259612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:30.261561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.262023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.262444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] PATH_INFO: `/v3/users/d3895de499034f2f919263e6485fd4e4` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.266701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3895de499034f2f919263e6485fd4e4)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:30.276181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:30.303258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-224635d9-e944-4ad0-b3dc-c581e3eca5e7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:30.324868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-224635d9-e944-4ad0-b3dc-c581e3eca5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:30.371380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 888/1803] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:30.372475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224635d9-e944-4ad0-b3dc-c581e3eca5e7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:30.408028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224635d9-e944-4ad0-b3dc-c581e3eca5e7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:30.437840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb843c7-8205-45c0-8746-ca0f39fde021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:30.439276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb843c7-8205-45c0-8746-ca0f39fde021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.439276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb843c7-8205-45c0-8746-ca0f39fde021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.439692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb843c7-8205-45c0-8746-ca0f39fde021 admin admin] PATH_INFO: `/v3/projects/a5f7747b28d648be9c76fb490e629a48/users/a4d902f5c3b249c49d7d1d728fafe918/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.467970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:30.498799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3895de499034f2f919263e6485fd4e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:30.509672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb843c7-8205-45c0-8746-ca0f39fde021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f7747b28d648be9c76fb490e629a48, user_id=a4d902f5c3b249c49d7d1d728fafe918, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:30.533254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb843c7-8205-45c0-8746-ca0f39fde021 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:30.534560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3895de499034f2f919263e6485fd4e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:30.543376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3895de499034f2f919263e6485fd4e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:30.544179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3895de499034f2f919263e6485fd4e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:30.555859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3895de499034f2f919263e6485fd4e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:30.575009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 889/1804] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:30 2022] PUT /identity/v3/projects/a5f7747b28d648be9c76fb490e629a48/users/a4d902f5c3b249c49d7d1d728fafe918/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:30.575009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2faf7-b13d-4c29-8f55-a609a20a61db None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.575839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2faf7-b13d-4c29-8f55-a609a20a61db None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.576608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2faf7-b13d-4c29-8f55-a609a20a61db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.610378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 916/1805] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:29 2022] DELETE /identity/v3/users/d3895de499034f2f919263e6485fd4e4 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:30.611805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:30.617344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:30.627703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-57a2faf7-b13d-4c29-8f55-a609a20a61db None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:30.639161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-57a2faf7-b13d-4c29-8f55-a609a20a61db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:30.746218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 890/1806] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:30.746218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936961bb-a353-4b40-abcd-806f54201dc2 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.746218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936961bb-a353-4b40-abcd-806f54201dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.746218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936961bb-a353-4b40-abcd-806f54201dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.770165 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-936961bb-a353-4b40-abcd-806f54201dc2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:30.771671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-936961bb-a353-4b40-abcd-806f54201dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:30.789355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 891/1807] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:30.790384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936961bb-a353-4b40-abcd-806f54201dc2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:30.807574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936961bb-a353-4b40-abcd-806f54201dc2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:30.813130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:30.814009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.814412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.815103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.815986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:30.816468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:30.819298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:30.835708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 892/1808] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:30.843269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:30.851506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:30.862220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01b3d-1469-4645-94b8-ce8f43578c73 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:30.871356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:30.872693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.873275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.874350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.876261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:30.880575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:30.885349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859c20d-4aba-488c-999d-2d977eff76f3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:30.905456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:30.908871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:30.909739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:30.911829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:30.913084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:30.915201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:30.950358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 917/1809] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:30.950358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:30.950637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 893/1810] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:30 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:30.951133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:30.951231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:31.060750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bd14f-e5d8-4606-b856-6806a692cc7b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:31.177988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:31.178646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.178986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.179277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.179902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78599-7206-48d1-a01e-41438b6d337c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:31.189914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dce1c-0600-4f24-bcf8-6f1296d2c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:31.191157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dce1c-0600-4f24-bcf8-6f1296d2c8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.191428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:31.191811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dce1c-0600-4f24-bcf8-6f1296d2c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.192365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dce1c-0600-4f24-bcf8-6f1296d2c8ce admin admin] PATH_INFO: `/v3/projects/a5f7747b28d648be9c76fb490e629a48/users/a4d902f5c3b249c49d7d1d728fafe918/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.193644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:31.194864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dce1c-0600-4f24-bcf8-6f1296d2c8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f7747b28d648be9c76fb490e629a48, user_id=a4d902f5c3b249c49d7d1d728fafe918, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:31.211369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dce1c-0600-4f24-bcf8-6f1296d2c8ce admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:31.213926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 918/1811] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:31.215015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:31.236526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874c845-489f-4170-9a4d-f8270cf93fbc service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:31.248038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 894/1812] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:30 2022] PUT /identity/v3/projects/a5f7747b28d648be9c76fb490e629a48/users/a4d902f5c3b249c49d7d1d728fafe918/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:31.250317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e333-b2d5-4341-a2d0-7a86bef73e11 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.250605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e333-b2d5-4341-a2d0-7a86bef73e11 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.250907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e333-b2d5-4341-a2d0-7a86bef73e11 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.252804 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 895/1813] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:22:31.268416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:31.272777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9327f1-f477-436f-8471-b724b3b2305b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.286370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9327f1-f477-436f-8471-b724b3b2305b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.286830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9327f1-f477-436f-8471-b724b3b2305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.351505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ef9327f1-f477-436f-8471-b724b3b2305b None None] MFA Rules not processed for user `a4d902f5c3b249c49d7d1d728fafe918`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:31.353732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ef9327f1-f477-436f-8471-b724b3b2305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:31.455029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7b1e1-c376-444e-ba99-8520db0c3e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:31.460114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7b1e1-c376-444e-ba99-8520db0c3e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.460473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7b1e1-c376-444e-ba99-8520db0c3e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.460704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7b1e1-c376-444e-ba99-8520db0c3e72 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.461476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7b1e1-c376-444e-ba99-8520db0c3e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:31.466350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7b1e1-c376-444e-ba99-8520db0c3e72 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:31.528145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 919/1814] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:31 2022] POST /identity/v3/users => generated 282 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:31.531438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed9df-0987-40df-be52-c48b46f6dcca None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.534530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed9df-0987-40df-be52-c48b46f6dcca None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.537052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed9df-0987-40df-be52-c48b46f6dcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.557719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 896/1815] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:31.560595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17616-1831-4eb1-92b8-774dd8743c44 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.562270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17616-1831-4eb1-92b8-774dd8743c44 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.562642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b17616-1831-4eb1-92b8-774dd8743c44 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.566925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 897/1816] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:22:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:22:31.570316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17616-1831-4eb1-92b8-774dd8743c44 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:31.582768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ab1ed9df-0987-40df-be52-c48b46f6dcca None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:31.588652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ab1ed9df-0987-40df-be52-c48b46f6dcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:31.605374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b17616-1831-4eb1-92b8-774dd8743c44 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:31.612051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:31.612970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.613606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.614336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.615374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:31.617593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:31.634640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 898/1817] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:31.635877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:31.638220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:31.778191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 920/1818] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:22:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:31.779407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ed9df-0987-40df-be52-c48b46f6dcca None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:31.792228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:31.799737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1b396-a6b3-4eac-973b-c91f930ce2fc admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:31.801729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ed9df-0987-40df-be52-c48b46f6dcca None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:31.812378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e10e9-2f6c-44a8-99c9-fe85a59c9738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:31.812681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:31.813889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e10e9-2f6c-44a8-99c9-fe85a59c9738 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.814106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.814399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.814722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.815020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e10e9-2f6c-44a8-99c9-fe85a59c9738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.815646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e10e9-2f6c-44a8-99c9-fe85a59c9738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.816787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e10e9-2f6c-44a8-99c9-fe85a59c9738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:31.819181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e10e9-2f6c-44a8-99c9-fe85a59c9738 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:31.824050 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:31.847513 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 921/1819] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:31.851566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808348-5e7d-409b-b123-044f0c94ee04 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.852681 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808348-5e7d-409b-b123-044f0c94ee04 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.853745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b808348-5e7d-409b-b123-044f0c94ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.890986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8b808348-5e7d-409b-b123-044f0c94ee04 None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:31.893610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8b808348-5e7d-409b-b123-044f0c94ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:31.915650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 922/1820] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:22:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:31.921459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b808348-5e7d-409b-b123-044f0c94ee04 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:31.948544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b808348-5e7d-409b-b123-044f0c94ee04 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:31.956768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:31.957804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:31.958163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:31.958519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] PATH_INFO: `/v3/projects/cfc6727bf60140b6bf82e5486f29eef9/users/66667183ba1c4878993478289475fe4e/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:31.969991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:31.971467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:32.000102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 899/1821] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:32.001051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc6727bf60140b6bf82e5486f29eef9, user_id=66667183ba1c4878993478289475fe4e, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:32.001998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:32.006610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:32.009071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:32.052269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 923/1822] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:31 2022] PUT /identity/v3/projects/cfc6727bf60140b6bf82e5486f29eef9/users/66667183ba1c4878993478289475fe4e/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:32.054638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:32.062474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:32.064145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e86a-b2eb-420a-b4b0-8931621bc856 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:32.172931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:32.240927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81c5f8-50bf-4c99-a831-f7e6a9d91a52 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:32.255795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5f778-5020-4680-b75f-a16c8e10c7c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:32.256631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f778-5020-4680-b75f-a16c8e10c7c7 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:32.257173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f778-5020-4680-b75f-a16c8e10c7c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:32.257564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f778-5020-4680-b75f-a16c8e10c7c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:32.269550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:32.272751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:32.273940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:32.276328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:32.287553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5f778-5020-4680-b75f-a16c8e10c7c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:32.296131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5f778-5020-4680-b75f-a16c8e10c7c7 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:32.306356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:32.308240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:32.318776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 924/1823] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:32.349302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ece38-cf92-416b-a1b8-83243c4fcb7c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:32.351293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 900/1824] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:32.353073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:32.353208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ece38-cf92-416b-a1b8-83243c4fcb7c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:32.353521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ece38-cf92-416b-a1b8-83243c4fcb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:32.357867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:32.504451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8e6ece38-cf92-416b-a1b8-83243c4fcb7c None None] MFA Rules not processed for user `66667183ba1c4878993478289475fe4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:32.509065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8e6ece38-cf92-416b-a1b8-83243c4fcb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:32.576531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761039f-82d2-4eaa-88b3-113adc9692db service nova] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:32.594554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:32.595466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:32.595753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:32.596031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] PATH_INFO: `/v3/projects/fdd14b7890b0406c9d42db85cafd848e` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:32.597300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd14b7890b0406c9d42db85cafd848e)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:32.599596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:32.754171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:32.781260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 925/1825] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:32.786486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ece38-cf92-416b-a1b8-83243c4fcb7c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:32.827613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ece38-cf92-416b-a1b8-83243c4fcb7c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:32.845818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd14b7890b0406c9d42db85cafd848e', 'request_id': 'req-e1876f42-1f0a-437a-87c2-6cc35953f764'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:32.886405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd14b7890b0406c9d42db85cafd848e', 'request_id': 'req-e1876f42-1f0a-437a-87c2-6cc35953f764'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:32.935713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd14b7890b0406c9d42db85cafd848e', 'request_id': 'req-e1876f42-1f0a-437a-87c2-6cc35953f764'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:32.998553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] The token cache is being invalidate because project fdd14b7890b0406c9d42db85cafd848e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:32.999616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.007479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.017426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 901/1826] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:32 2022] DELETE /identity/v3/projects/fdd14b7890b0406c9d42db85cafd848e => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:33.022140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.023635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:33.059027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.059861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.060216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.061124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.061591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.066194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.160803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 926/1827] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:32 2022] POST /identity/v3/projects => generated 365 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:33.164989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.170473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:33.219345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1876f42-1f0a-437a-87c2-6cc35953f764 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.306328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:33.324922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473154e-3a90-4d68-9415-1e6c00fec66e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.334395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.335291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.335696 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.336206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.337190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.343959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.344317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.344503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.344748 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.345012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] PATH_INFO: `/v3/users/d32310d6e44748dab5b2021c0f048d5c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.348339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32310d6e44748dab5b2021c0f048d5c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.350718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.373033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 927/1828] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:33 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:33.377043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.388687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7b18-cab3-4ddf-83bd-de0ac721c9b9 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.393572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.394344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.394546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.394871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.395701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.397311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.409208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 928/1829] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:33.417420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.430218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32310d6e44748dab5b2021c0f048d5c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.432288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3eb5-cd46-4838-b010-da849eb91012 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.439512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.440427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.440721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.441031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] PATH_INFO: `/v3/projects/e718bb1f967c45b6b543744b736f3570/users/e916f788278d4cc7840ad12a53ff30bd/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.448116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32310d6e44748dab5b2021c0f048d5c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.449116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32310d6e44748dab5b2021c0f048d5c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.449959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32310d6e44748dab5b2021c0f048d5c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.452311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:33.460255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e718bb1f967c45b6b543744b736f3570, user_id=e916f788278d4cc7840ad12a53ff30bd, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.460630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32310d6e44748dab5b2021c0f048d5c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.463003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.493451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 929/1830] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:33 2022] PUT /identity/v3/projects/e718bb1f967c45b6b543744b736f3570/users/e916f788278d4cc7840ad12a53ff30bd/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:33.497969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 902/1831] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:33 2022] DELETE /identity/v3/users/d32310d6e44748dab5b2021c0f048d5c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:33.504413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.508078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:33.597919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8644a2-a945-4be9-8eb0-d3c72675fcdd admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.668722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083b121-3533-411a-9907-bb2402c5e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.669424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083b121-3533-411a-9907-bb2402c5e756 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.669765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083b121-3533-411a-9907-bb2402c5e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.670043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083b121-3533-411a-9907-bb2402c5e756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.670967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083b121-3533-411a-9907-bb2402c5e756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.672628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083b121-3533-411a-9907-bb2402c5e756 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.686330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 930/1832] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:33.690579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.702983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b5875-f808-4f89-bfb4-f5e577e0901d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.708883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.710321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.710830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.711431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] PATH_INFO: `/v3/projects/e718bb1f967c45b6b543744b736f3570/users/e916f788278d4cc7840ad12a53ff30bd/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.715357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e718bb1f967c45b6b543744b736f3570, user_id=e916f788278d4cc7840ad12a53ff30bd, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.720377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.734523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 903/1833] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:33 2022] PUT /identity/v3/projects/e718bb1f967c45b6b543744b736f3570/users/e916f788278d4cc7840ad12a53ff30bd/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:33.747044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.747385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.747671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.781017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] MFA Rules not processed for user `e916f788278d4cc7840ad12a53ff30bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:33.782282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:33.816727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.818673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:33.850115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:33.891311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 931/1834] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:33.898325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444c24c-f1bb-422a-9673-2792ee698f6a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.898908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:33.900455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:33.904534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:33.905817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:33.906096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:33.906380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] PATH_INFO: `/v3/projects/8a48e9e1dce24aa1be79db241c85c00f` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:33.907678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a48e9e1dce24aa1be79db241c85c00f)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:33.909616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:33.976882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a48e9e1dce24aa1be79db241c85c00f', 'request_id': 'req-4c806837-ad5f-4c80-828e-f7a2dc782cb2'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.988146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a48e9e1dce24aa1be79db241c85c00f', 'request_id': 'req-4c806837-ad5f-4c80-828e-f7a2dc782cb2'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:33.990719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d0ee8-e008-4344-96ce-3a03bfd57d60 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:33.998850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a48e9e1dce24aa1be79db241c85c00f', 'request_id': 'req-4c806837-ad5f-4c80-828e-f7a2dc782cb2'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:34.017871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] The token cache is being invalidate because project 8a48e9e1dce24aa1be79db241c85c00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:34.018396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:34.019488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4c806837-ad5f-4c80-828e-f7a2dc782cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:34.022396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 904/1835] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:33 2022] DELETE /identity/v3/projects/8a48e9e1dce24aa1be79db241c85c00f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:34.029724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b1ced-a6a6-456c-8b46-2165b1a6ce2b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.030198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b1ced-a6a6-456c-8b46-2165b1a6ce2b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.030722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b1ced-a6a6-456c-8b46-2165b1a6ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.062638 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f74b1ced-a6a6-456c-8b46-2165b1a6ce2b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:34.063932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f74b1ced-a6a6-456c-8b46-2165b1a6ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:34.085620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.087107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.087390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.087694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.090435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:34.135133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 905/1836] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:34.142867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0184c4-33c4-4eb8-b42a-2b55a6f2b11c None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.143195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0184c4-33c4-4eb8-b42a-2b55a6f2b11c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.143481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0184c4-33c4-4eb8-b42a-2b55a6f2b11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.149881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:34.167449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-dd0184c4-33c4-4eb8-b42a-2b55a6f2b11c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:34.169452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dd0184c4-33c4-4eb8-b42a-2b55a6f2b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:34.180801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 906/1837] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:34.185529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0184c4-33c4-4eb8-b42a-2b55a6f2b11c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:34.187415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.188863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.195286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0184c4-33c4-4eb8-b42a-2b55a6f2b11c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:34.200037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 932/1838] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:34.202615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.203326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.203611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.203891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.204626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:34.204935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.206564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.220373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 907/1839] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:22:34.225187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:34.243604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe38f-d508-44e9-a826-7880197db32f service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:34.249252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.249986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.250274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.250608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.252719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.253206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.282387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:34.284247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:34.295048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 933/1840] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:34 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:34.296525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:34.303447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3a3cf-6075-4257-8bfb-264ce86b3be6 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:34.330610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:34.395222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.396349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.396913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.397200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.399479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:34.409473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21198b27-9202-40e6-96de-87f68bac0568 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:34.414891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.415576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.416375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.416696 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.418791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.425423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.481884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 934/1841] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:34 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:34.482888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:34.508059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2710-1220-4974-9ebc-110e66c4b433 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:34.529947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.532233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.532890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.533179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.537857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.542387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.562316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 935/1842] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:34.563298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:34.565741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.567347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.578286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23020bb2-6837-4a24-9c6e-e315a31cb162 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:34.579628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 908/1843] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:34.599897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b796fc-9fa3-44af-a761-e8783c246713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.604108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b796fc-9fa3-44af-a761-e8783c246713 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.604560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b796fc-9fa3-44af-a761-e8783c246713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.605165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b796fc-9fa3-44af-a761-e8783c246713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.606945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b796fc-9fa3-44af-a761-e8783c246713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.612332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b796fc-9fa3-44af-a761-e8783c246713 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.624579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 936/1844] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:34.629828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:34.645999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64727053-235e-48c5-8d6e-559322f0c5e3 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:34.653410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:34.654328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.654597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.654909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] PATH_INFO: `/v3/projects/3004bfc4fed34497995fe17838250ac4/users/64dfd59889bf45f89f89df60c4595577/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.676726 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3004bfc4fed34497995fe17838250ac4, user_id=64dfd59889bf45f89f89df60c4595577, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:34.680647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:34.703224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 909/1845] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:34 2022] PUT /identity/v3/projects/3004bfc4fed34497995fe17838250ac4/users/64dfd59889bf45f89f89df60c4595577/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:34.716642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae38416-d4a3-456c-bc7f-02ad1d805dbb None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:34.717237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae38416-d4a3-456c-bc7f-02ad1d805dbb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:34.717685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae38416-d4a3-456c-bc7f-02ad1d805dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:34.782500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5ae38416-d4a3-456c-bc7f-02ad1d805dbb None None] MFA Rules not processed for user `64dfd59889bf45f89f89df60c4595577`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:34.783984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5ae38416-d4a3-456c-bc7f-02ad1d805dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:34.939158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 937/1846] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:34.945754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:35.040510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a827-74f0-47dc-b341-1cbc80a9c6d7 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:35.045781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:35.046646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:35.047067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:35.047573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:35.048415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:35.051277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:35.081266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:35.093194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 910/1847] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:34 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:35.097344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae38416-d4a3-456c-bc7f-02ad1d805dbb None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:35.111996 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae38416-d4a3-456c-bc7f-02ad1d805dbb None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:35.243003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:35.243707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:35.244897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:35.245184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:35.245902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:35.247888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:35.275397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 938/1848] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:35 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:35.279482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:35.290338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92422-4fc5-4fa7-b627-d10f21c30122 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:35.297385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:35.298417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:35.298764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:35.299081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:35.299849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:35.301927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:35.439969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 911/1849] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:35.444617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:35.469631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf2b10-bffc-4faa-a371-77090a8a4a0b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:35.476854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:35.477769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:35.478054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:35.478328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] PATH_INFO: `/v3/projects/11c0074a18c24307a4257644fe6098ca/users/d44a157c8ce94333af31a4c41ace4d4a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:35.481639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:35.498481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c0074a18c24307a4257644fe6098ca, user_id=d44a157c8ce94333af31a4c41ace4d4a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:35.501279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:35.522307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 939/1850] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:35 2022] PUT /identity/v3/projects/11c0074a18c24307a4257644fe6098ca/users/d44a157c8ce94333af31a4c41ace4d4a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:35.527178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:35.538119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e3add-f9b3-4382-aa84-c2298de45f0e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:35.641357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702e27b-6159-4546-880d-252049de4cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:35.642415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e27b-6159-4546-880d-252049de4cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:35.642716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e27b-6159-4546-880d-252049de4cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:35.643011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702e27b-6159-4546-880d-252049de4cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:35.643778 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702e27b-6159-4546-880d-252049de4cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:35.646440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702e27b-6159-4546-880d-252049de4cf8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:35.661406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 912/1851] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:35.665625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:35.683943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd139a-7c21-449f-85eb-f451d77fc4cf admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:35.701028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:35.702226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:35.702505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:35.702826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] PATH_INFO: `/v3/projects/11c0074a18c24307a4257644fe6098ca/users/d44a157c8ce94333af31a4c41ace4d4a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:35.717604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c0074a18c24307a4257644fe6098ca, user_id=d44a157c8ce94333af31a4c41ace4d4a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:35.720774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:35.790247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 940/1852] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:35 2022] PUT /identity/v3/projects/11c0074a18c24307a4257644fe6098ca/users/d44a157c8ce94333af31a4c41ace4d4a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:35.792464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08a8b-5cdb-4813-bb35-85e73fb3365a None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:35.793094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08a8b-5cdb-4813-bb35-85e73fb3365a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:35.793711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08a8b-5cdb-4813-bb35-85e73fb3365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:35.859717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1cd08a8b-5cdb-4813-bb35-85e73fb3365a None None] MFA Rules not processed for user `d44a157c8ce94333af31a4c41ace4d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:35.861486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1cd08a8b-5cdb-4813-bb35-85e73fb3365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:36.014205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 913/1853] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:36.023532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:36.026161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:36.136750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4237f-f60e-453d-aac6-7ce31fdc84f6 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:36.141225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa2ac3-35ee-48ff-8533-af6be5cd9477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:36.142113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa2ac3-35ee-48ff-8533-af6be5cd9477 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:36.142463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa2ac3-35ee-48ff-8533-af6be5cd9477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:36.142920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa2ac3-35ee-48ff-8533-af6be5cd9477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:36.156051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa2ac3-35ee-48ff-8533-af6be5cd9477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:36.158426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa2ac3-35ee-48ff-8533-af6be5cd9477 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:36.186821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 941/1854] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:36.517376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08a8b-5cdb-4813-bb35-85e73fb3365a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:36.709989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08a8b-5cdb-4813-bb35-85e73fb3365a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:36.716316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:36.717229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:36.717509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:36.717794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] PATH_INFO: `/v3/users/64dfd59889bf45f89f89df60c4595577` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:36.719183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64dfd59889bf45f89f89df60c4595577)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:36.721975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:36.741233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:36.804059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64dfd59889bf45f89f89df60c4595577'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:36.845206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64dfd59889bf45f89f89df60c4595577'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:36.850093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64dfd59889bf45f89f89df60c4595577'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:36.851187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64dfd59889bf45f89f89df60c4595577'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:36.896196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64dfd59889bf45f89f89df60c4595577'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:36.931846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 914/1855] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:36 2022] DELETE /identity/v3/users/64dfd59889bf45f89f89df60c4595577 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:36.940527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:36.941128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:36.941686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:36.999062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:37.004415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:37.178112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 942/1856] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:37.193689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:37.195572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:37.324328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7176a-2e45-4827-8e7b-3b743ae9e950 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:37.330603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:37.331881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:37.332133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:37.332421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:37.348618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:37.351078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:37.386919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 915/1857] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:37.726902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:37.729707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:37.742318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:37.745503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:37.749639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f3b90-61b7-42dc-8d8f-872492f933bf None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:37.755932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:37.756917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:37.757182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:37.758327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] PATH_INFO: `/v3/projects/3004bfc4fed34497995fe17838250ac4` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:37.759732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3004bfc4fed34497995fe17838250ac4)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:37.762006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:37.762369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96be78e-9f42-4a80-88c5-c028c8473f68 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:37.768488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:37.770122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:37.770631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:37.771042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] PATH_INFO: `/v3/users/f9f06fd8e2454876be43060c7b7330b9` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:37.772591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f06fd8e2454876be43060c7b7330b9)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:37.774994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:37.833176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3004bfc4fed34497995fe17838250ac4', 'request_id': 'req-739bfb01-39d5-4599-842b-e5e829d9c7b9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.847898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3004bfc4fed34497995fe17838250ac4', 'request_id': 'req-739bfb01-39d5-4599-842b-e5e829d9c7b9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.856046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3004bfc4fed34497995fe17838250ac4', 'request_id': 'req-739bfb01-39d5-4599-842b-e5e829d9c7b9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.861745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:37.863195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f06fd8e2454876be43060c7b7330b9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.873642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] The token cache is being invalidate because project 3004bfc4fed34497995fe17838250ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:37.875307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.876409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.878216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 943/1858] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:37 2022] DELETE /identity/v3/projects/3004bfc4fed34497995fe17838250ac4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:37.881921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:37.883417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:37.883964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f06fd8e2454876be43060c7b7330b9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.885423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f06fd8e2454876be43060c7b7330b9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.886219 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f06fd8e2454876be43060c7b7330b9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.899540 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f06fd8e2454876be43060c7b7330b9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:37.924699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 916/1859] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:37 2022] DELETE /identity/v3/users/f9f06fd8e2454876be43060c7b7330b9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:37.927744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:37.932648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:37.944529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:38.020548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bfb01-39d5-4599-842b-e5e829d9c7b9 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:38.060046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee63ca-9aee-4fdc-8577-925085006111 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:38.066508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:38.067541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:38.067888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:38.069387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] PATH_INFO: `/v3/users/d44a157c8ce94333af31a4c41ace4d4a` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:38.072524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44a157c8ce94333af31a4c41ace4d4a)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:38.077017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:38.161843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44a157c8ce94333af31a4c41ace4d4a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.178722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44a157c8ce94333af31a4c41ace4d4a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.179655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44a157c8ce94333af31a4c41ace4d4a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.180523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44a157c8ce94333af31a4c41ace4d4a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.193939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9031a316-a4b0-4da4-b9c3-1e91d0dd862b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44a157c8ce94333af31a4c41ace4d4a'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.218311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 917/1860] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:37 2022] DELETE /identity/v3/users/d44a157c8ce94333af31a4c41ace4d4a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:38.218311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:38.218311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:38.218311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:38.242893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:38.244414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:38.244705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:38.244984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] PATH_INFO: `/v3/users/66667183ba1c4878993478289475fe4e` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:38.247192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=66667183ba1c4878993478289475fe4e)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:38.249161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:38.249303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:38.250770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:38.381422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66667183ba1c4878993478289475fe4e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.404918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66667183ba1c4878993478289475fe4e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.405642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66667183ba1c4878993478289475fe4e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.407029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66667183ba1c4878993478289475fe4e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.415515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 918/1861] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:38.418865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-83e0b316-e3fe-435a-b69d-effab051d4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66667183ba1c4878993478289475fe4e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:38.435985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:38.437625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:38.440678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 944/1862] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:37 2022] DELETE /identity/v3/users/66667183ba1c4878993478289475fe4e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:38.450291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:38.451967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:38.454059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:38.473186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:38.480173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:38.481470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:38.511238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:38.563557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8f3b-4cf4-483d-9d71-c39022a87515 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:38.603778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 945/1863] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:38.682796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:38.684868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:38.720274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:38.722088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:38.725027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:38.725201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:38.761982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:38.766498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:38.814572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 919/1864] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:38.854537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282584c-3dc9-4ddf-9093-a2504ff77d8a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:38.860875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6295-0486-4218-966c-56f253e002f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:38.861733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6295-0486-4218-966c-56f253e002f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:38.861979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6295-0486-4218-966c-56f253e002f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:38.862327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6295-0486-4218-966c-56f253e002f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:38.874678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6295-0486-4218-966c-56f253e002f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:38.876262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6295-0486-4218-966c-56f253e002f7 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:38.888606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 946/1865] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:40.183887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:40.185474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:40.201566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b7b1-5a9e-4e19-a820-efb29e36133a service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:40.217715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:40.218604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:40.218918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:40.219201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] PATH_INFO: `/v3/projects/11c0074a18c24307a4257644fe6098ca` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:40.222391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c0074a18c24307a4257644fe6098ca)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:40.224484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:40.367091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c0074a18c24307a4257644fe6098ca', 'request_id': 'req-95bd91db-6136-474a-be8c-da139a52eefd'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.390221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c0074a18c24307a4257644fe6098ca', 'request_id': 'req-95bd91db-6136-474a-be8c-da139a52eefd'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.400623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c0074a18c24307a4257644fe6098ca', 'request_id': 'req-95bd91db-6136-474a-be8c-da139a52eefd'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.448620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] The token cache is being invalidate because project 11c0074a18c24307a4257644fe6098ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:40.449016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.449862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-95bd91db-6136-474a-be8c-da139a52eefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.452067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 920/1866] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:40 2022] DELETE /identity/v3/projects/11c0074a18c24307a4257644fe6098ca => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:40.457473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:40.457977 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:40.458075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:40.490353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:40.498235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:40.630872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 947/1867] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:40.640021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b5f2-ff74-4e69-96e5-ae611fd03ff5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:40.640384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b5f2-ff74-4e69-96e5-ae611fd03ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:40.640598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b5f2-ff74-4e69-96e5-ae611fd03ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:40.640780 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:40.643469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:40.658409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f853-b7d6-4946-a473-02687695617d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:40.674307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:40.675680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:40.677537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:40.677817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] PATH_INFO: `/v3/projects/714a6e841c1742c2b64b1ffb73c8010a` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:40.681646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=714a6e841c1742c2b64b1ffb73c8010a)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:40.684731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3207b5f2-ff74-4e69-96e5-ae611fd03ff5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:40.684938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:40.685968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3207b5f2-ff74-4e69-96e5-ae611fd03ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:40.708712 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 921/1868] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:40.709846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207b5f2-ff74-4e69-96e5-ae611fd03ff5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:40.727412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207b5f2-ff74-4e69-96e5-ae611fd03ff5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:40.751869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:40.752975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:40.753411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:40.755208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:40.756470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:40.756838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:40.759537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:40.781978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 922/1869] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:22:40.787432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:40.799190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714a6e841c1742c2b64b1ffb73c8010a', 'request_id': 'req-1c41a6ae-1640-4274-8f07-b347e8da1e0d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.807229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a4bdf-044a-44da-acdc-1b3aca3713eb admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:40.811570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714a6e841c1742c2b64b1ffb73c8010a', 'request_id': 'req-1c41a6ae-1640-4274-8f07-b347e8da1e0d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.829063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714a6e841c1742c2b64b1ffb73c8010a', 'request_id': 'req-1c41a6ae-1640-4274-8f07-b347e8da1e0d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.833163 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:40.862001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] The token cache is being invalidate because project 714a6e841c1742c2b64b1ffb73c8010a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:40.862289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.863119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:40.866730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 948/1870] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:40 2022] DELETE /identity/v3/projects/714a6e841c1742c2b64b1ffb73c8010a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:40.871999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:40.873019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:40.903626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:40.948392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:40.949211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:40.949554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:40.949911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:40.950621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:40.952852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.009901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 923/1871] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:40 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:41.011184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:41.013665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:41.058405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41a6ae-1640-4274-8f07-b347e8da1e0d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.108672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941fbb0-d29b-4563-913e-036708c03aab admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.115888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.116889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.117158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.117429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] PATH_INFO: `/v3/users/a4d902f5c3b249c49d7d1d728fafe918` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.118925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d902f5c3b249c49d7d1d728fafe918)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.122031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.149499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.151074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.151477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.152149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] PATH_INFO: `/v3/projects/cfc6727bf60140b6bf82e5486f29eef9` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.153584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc6727bf60140b6bf82e5486f29eef9)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.155894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.206932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d902f5c3b249c49d7d1d728fafe918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.221783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d902f5c3b249c49d7d1d728fafe918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.222543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d902f5c3b249c49d7d1d728fafe918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.223311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d902f5c3b249c49d7d1d728fafe918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.225104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc6727bf60140b6bf82e5486f29eef9', 'request_id': 'req-a3d42689-e624-44cc-87e2-a663b5c751f7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.230732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d902f5c3b249c49d7d1d728fafe918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.236175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc6727bf60140b6bf82e5486f29eef9', 'request_id': 'req-a3d42689-e624-44cc-87e2-a663b5c751f7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.244760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc6727bf60140b6bf82e5486f29eef9', 'request_id': 'req-a3d42689-e624-44cc-87e2-a663b5c751f7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.260731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] The token cache is being invalidate because project cfc6727bf60140b6bf82e5486f29eef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:41.261353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.261969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.268483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 924/1873] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:41 2022] DELETE /identity/v3/users/a4d902f5c3b249c49d7d1d728fafe918 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:41.268628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 949/1873] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:40 2022] DELETE /identity/v3/projects/cfc6727bf60140b6bf82e5486f29eef9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:41.269186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:41.269391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:41.271519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:41.275814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:41.317917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:41.375420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:41.400736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42689-e624-44cc-87e2-a663b5c751f7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.411663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.413402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.413691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.413986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] PATH_INFO: `/v3/users/e916f788278d4cc7840ad12a53ff30bd` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.415490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e916f788278d4cc7840ad12a53ff30bd)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.416859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412790a6-3c91-40a2-8097-8ed5b65cd262 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.417535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.425293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.426127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.426562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.426960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.427789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.430649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.467184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 925/1874] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:41 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:41.471628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:41.476526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:41.511522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9dc1c-6d6f-4bec-a826-2c93c252a4ca admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.518427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.519682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.520318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.520808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.521820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.524014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.528730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e916f788278d4cc7840ad12a53ff30bd'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.541670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 926/1875] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:41.545508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:41.555818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e916f788278d4cc7840ad12a53ff30bd'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.557552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e916f788278d4cc7840ad12a53ff30bd'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.558244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e916f788278d4cc7840ad12a53ff30bd'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.560193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f75c1a-c1e0-4d20-a1c7-1a1d2382dd6f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.565629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.566370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.566654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.567144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.567899 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.569692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.571294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-861348db-efdc-4b56-9679-bcfa2ca12621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e916f788278d4cc7840ad12a53ff30bd'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:41.588488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 927/1876] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:41.590099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:41.592984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:41.611261 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff55e4-efe0-4004-b21a-6ce6cae9b389 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.617218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.618176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.618463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.619348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] PATH_INFO: `/v3/projects/a132fe724bad40179171739350bbab0e/users/81d55f4f3fea4d2ea838f42310a91480/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.631857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 950/1877] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:41 2022] DELETE /identity/v3/users/e916f788278d4cc7840ad12a53ff30bd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:41.641334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a132fe724bad40179171739350bbab0e, user_id=81d55f4f3fea4d2ea838f42310a91480, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.644573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:41.670761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 928/1878] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:41 2022] PUT /identity/v3/projects/a132fe724bad40179171739350bbab0e/users/81d55f4f3fea4d2ea838f42310a91480/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:41.678190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bffd7b-695b-442e-9321-6eb9d22dbb90 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.678661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bffd7b-695b-442e-9321-6eb9d22dbb90 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.678991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bffd7b-695b-442e-9321-6eb9d22dbb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.713438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-77bffd7b-695b-442e-9321-6eb9d22dbb90 None None] MFA Rules not processed for user `81d55f4f3fea4d2ea838f42310a91480`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:41.715228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-77bffd7b-695b-442e-9321-6eb9d22dbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:41.837921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 951/1879] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:41.839363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:41.937577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14334-b7cd-4091-b72d-c42ef3596140 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:41.943872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:41.944657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:41.945047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:41.945524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:41.946286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:41.949245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:42.002800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 929/1880] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:41 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:42.007230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bffd7b-695b-442e-9321-6eb9d22dbb90 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:42.026393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bffd7b-695b-442e-9321-6eb9d22dbb90 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:42.136807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:42.199116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:42.200497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:42.201017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:42.201948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:42.203932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:42.207036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:42.265569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 952/1881] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:42 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:42.269524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:42.284467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e9aea-2c5d-41dc-bfba-4f10e4c77cc8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:42.299502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:42.300165 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:42.300454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:42.302381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:42.303141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:42.308183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:42.335298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 930/1882] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:42.339157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:42.355293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8798fa-906e-48d2-8be5-06e80b13cc7e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:42.361447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:42.362472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:42.362905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:42.363259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] PATH_INFO: `/v3/projects/d8d0cb06fc49463ea89e7a9e516f9954/users/bad5da2abff344acb32a4456b987a317/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:42.380742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d0cb06fc49463ea89e7a9e516f9954, user_id=bad5da2abff344acb32a4456b987a317, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:42.383641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:42.405436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 953/1883] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:42 2022] PUT /identity/v3/projects/d8d0cb06fc49463ea89e7a9e516f9954/users/bad5da2abff344acb32a4456b987a317/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:42.410169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:42.424899 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083508ac-6a61-4fab-95c1-fc176a5361a5 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:42.575714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652accc-a63f-47c4-ac9e-d49461de9159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:42.576715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652accc-a63f-47c4-ac9e-d49461de9159 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:42.577168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652accc-a63f-47c4-ac9e-d49461de9159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:42.578350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652accc-a63f-47c4-ac9e-d49461de9159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:42.579369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652accc-a63f-47c4-ac9e-d49461de9159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:42.585031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652accc-a63f-47c4-ac9e-d49461de9159 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:42.605157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 931/1884] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:42.611723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:42.621628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28a80-c2d4-48a9-b810-1e4e797ec362 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:42.626892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:42.627875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:42.628285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:42.628675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] PATH_INFO: `/v3/projects/d8d0cb06fc49463ea89e7a9e516f9954/users/bad5da2abff344acb32a4456b987a317/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:42.631150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d0cb06fc49463ea89e7a9e516f9954, user_id=bad5da2abff344acb32a4456b987a317, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:42.636515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:42.688522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 954/1885] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:42 2022] PUT /identity/v3/projects/d8d0cb06fc49463ea89e7a9e516f9954/users/bad5da2abff344acb32a4456b987a317/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:42.708741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:42.709435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:42.710030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:42.721298 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:42.769169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] MFA Rules not processed for user `bad5da2abff344acb32a4456b987a317`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:42.770906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:42.835407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:42.838129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:42.919447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 932/1886] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:42.931985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:42.933490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:42.966408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72546560-309e-495c-8114-7c423d686d87 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:42.972648 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:42.974113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:42.974113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:42.974113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] PATH_INFO: `/v3/projects/a5f7747b28d648be9c76fb490e629a48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:42.975368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f7747b28d648be9c76fb490e629a48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:42.977344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.003979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380433c-f316-4bed-9604-09449d0311a7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:43.008098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91ed02-2824-42de-b855-3be294e34534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:43.008855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ed02-2824-42de-b855-3be294e34534 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.009214 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ed02-2824-42de-b855-3be294e34534 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.010253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91ed02-2824-42de-b855-3be294e34534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.023818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91ed02-2824-42de-b855-3be294e34534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:43.025394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91ed02-2824-42de-b855-3be294e34534 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.038500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 933/1887] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:43.043721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f7747b28d648be9c76fb490e629a48', 'request_id': 'req-0eceb1c1-47a4-411e-8855-1b05eb35abaf'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:43.054965 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f7747b28d648be9c76fb490e629a48', 'request_id': 'req-0eceb1c1-47a4-411e-8855-1b05eb35abaf'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:43.063371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f7747b28d648be9c76fb490e629a48', 'request_id': 'req-0eceb1c1-47a4-411e-8855-1b05eb35abaf'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:43.076406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] The token cache is being invalidate because project a5f7747b28d648be9c76fb490e629a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:43.076729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:43.077383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:43.079245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 955/1888] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:42 2022] DELETE /identity/v3/projects/a5f7747b28d648be9c76fb490e629a48 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:43.084074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f059-f5f3-458b-b6b7-91682143d2d7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.085015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f059-f5f3-458b-b6b7-91682143d2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.085015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4f059-f5f3-458b-b6b7-91682143d2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.117630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-14e4f059-f5f3-458b-b6b7-91682143d2d7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:43.119641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-14e4f059-f5f3-458b-b6b7-91682143d2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:43.137282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:43.139291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:43.168621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:43.235516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 934/1889] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:43.238083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff46069-2672-4bc9-8516-9bd4a580eb6b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.238510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff46069-2672-4bc9-8516-9bd4a580eb6b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.238995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff46069-2672-4bc9-8516-9bd4a580eb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.286134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb1c1-47a4-411e-8855-1b05eb35abaf admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:43.300204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:43.300826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.301115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.301393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.303957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0ff46069-2672-4bc9-8516-9bd4a580eb6b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:43.305811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0ff46069-2672-4bc9-8516-9bd4a580eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:43.310673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:43.322278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 935/1890] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:43.324853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff46069-2672-4bc9-8516-9bd4a580eb6b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:43.339635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff46069-2672-4bc9-8516-9bd4a580eb6b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:43.345904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:43.346924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.347424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.348152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.349098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:43.349640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:43.352513 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.392430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 936/1891] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:43.394670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:43.423501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e8557-674c-4558-bc5c-df01ef7596dd admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:43.434024 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:43.434990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.435356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.436195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.438752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:43.442062 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.461532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:43.500723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:43.503770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.557781 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 937/1892] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:43 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:43.560826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:43.568256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 956/1893] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:43.740577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482991fb-3308-4603-9464-0df7957ccf2e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:43.758584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:43.759501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.759982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.760278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.761324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:43.764604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.818433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:43.820830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:43.828487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 938/1894] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:43 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:43.832980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:43.852086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45812ae9-0665-45f5-bf92-ac1d90fc7e23 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:43.866844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:43.867911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.868316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.868730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] PATH_INFO: `/v3/projects/e718bb1f967c45b6b543744b736f3570` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.872250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd37c0e-bfb2-462c-b41e-475d4f2c31a0 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:43.876931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e718bb1f967c45b6b543744b736f3570)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:43.883871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.890101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:43.893409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:43.894913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:43.895400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:43.896465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:43.906958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:43.949326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 939/1895] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:43.950242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:43.996699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab14ba-520b-49ca-9a5e-a97a705cbb46 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.014890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.017836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.018136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.018421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.019474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:44.022369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:44.065238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e718bb1f967c45b6b543744b736f3570', 'request_id': 'req-775f3fd0-a077-4b43-b8a1-e572dc066ebb'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:44.077296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 940/1896] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:44.078362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:44.089103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e718bb1f967c45b6b543744b736f3570', 'request_id': 'req-775f3fd0-a077-4b43-b8a1-e572dc066ebb'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:44.096952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f5265-8ed9-44a9-a1f7-b252a2cde111 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.104435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e718bb1f967c45b6b543744b736f3570', 'request_id': 'req-775f3fd0-a077-4b43-b8a1-e572dc066ebb'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:44.174290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] The token cache is being invalidate because project e718bb1f967c45b6b543744b736f3570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:44.174957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:44.177766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-775f3fd0-a077-4b43-b8a1-e572dc066ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:44.187937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 957/1897] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:43 2022] DELETE /identity/v3/projects/e718bb1f967c45b6b543744b736f3570 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:44.196461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae1c0e-46d3-4562-abef-d69ab24756b1 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.196461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae1c0e-46d3-4562-abef-d69ab24756b1 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.198394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae1c0e-46d3-4562-abef-d69ab24756b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.233843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b0ae1c0e-46d3-4562-abef-d69ab24756b1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:44.235773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b0ae1c0e-46d3-4562-abef-d69ab24756b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:44.286381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a035-8085-4c2d-8cec-cb60916c83ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.290173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a035-8085-4c2d-8cec-cb60916c83ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.290504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a035-8085-4c2d-8cec-cb60916c83ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.290819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a035-8085-4c2d-8cec-cb60916c83ef admin admin] PATH_INFO: `/v3/projects/3ffb0dd5f1f342ad9f2eacfb8dac4fad/users/2505160f29584203bcce446891fc72e9/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.307402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 958/1898] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:44.315647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0f696-2afb-4145-b097-d0fee559b526 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.316003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0f696-2afb-4145-b097-d0fee559b526 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.316361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0f696-2afb-4145-b097-d0fee559b526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.327048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a035-8085-4c2d-8cec-cb60916c83ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffb0dd5f1f342ad9f2eacfb8dac4fad, user_id=2505160f29584203bcce446891fc72e9, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:44.331740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a035-8085-4c2d-8cec-cb60916c83ef admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:44.354657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 941/1899] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:44 2022] PUT /identity/v3/projects/3ffb0dd5f1f342ad9f2eacfb8dac4fad/users/2505160f29584203bcce446891fc72e9/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:44.368224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.370950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.371647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.386423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e8f0f696-2afb-4145-b097-d0fee559b526 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:44.389544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e8f0f696-2afb-4145-b097-d0fee559b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:44.403870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] MFA Rules not processed for user `2505160f29584203bcce446891fc72e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:44.405681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:44.493175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:44.535706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:44.572709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 959/1900] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:44.577421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0f696-2afb-4145-b097-d0fee559b526 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:44.589507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 942/1901] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:44.594965 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0f696-2afb-4145-b097-d0fee559b526 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.603669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:44.605216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:44.615694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.616380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.616662 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.616935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.617669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:44.617983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:44.620273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:44.635927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 960/1902] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:44.641638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:44.653440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0d708-e7ad-4e8a-a52a-e79ae80e00cc admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.669796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.670480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.670800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.671073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.671843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:44.673773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:44.738295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87ab4b-5b3e-4235-91f3-62f5fd746309 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.742734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 961/1903] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:44 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:44.744602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:44.854669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.855982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.856450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.856734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.865830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97aec9-467e-4759-bc9a-691d91bd8f81 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.872120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.873160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.873298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.873493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.874378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:44.876312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:44.915304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 962/1904] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:44 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:44.919716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:44.932353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795dc0-f53b-4617-ad59-4c29fc6c6455 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.937420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.938099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.938381 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:44.938656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:44.939633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:44.941470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:44.949002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:44.950485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:44.959921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 963/1905] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:44.965037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 943/1906] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:44.968885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:44.988529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8468d9-9ca4-40eb-b1e2-ef9330763ad1 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:44.998068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddcf63-fc73-4267-bd02-def7f1d19b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:44.999165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddcf63-fc73-4267-bd02-def7f1d19b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:44.999738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddcf63-fc73-4267-bd02-def7f1d19b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.000194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddcf63-fc73-4267-bd02-def7f1d19b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.002101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddcf63-fc73-4267-bd02-def7f1d19b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.003058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddcf63-fc73-4267-bd02-def7f1d19b22 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.022495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 964/1907] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:45.026965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.039954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf8f8-f40e-44b9-a0b4-6cd0c1147275 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:45.045424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:45.046336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.046617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.046936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] PATH_INFO: `/v3/projects/a205fdafc0f246dbb3cdc9e568aff058/users/4f13dae49d6b490cb7b86a611f09ebcc/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.076822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a205fdafc0f246dbb3cdc9e568aff058, user_id=4f13dae49d6b490cb7b86a611f09ebcc, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.085755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.114777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 944/1908] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:45 2022] PUT /identity/v3/projects/a205fdafc0f246dbb3cdc9e568aff058/users/4f13dae49d6b490cb7b86a611f09ebcc/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:45.120265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2dfd2-61cb-4813-beb9-80c2f40fbec0 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.120637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2dfd2-61cb-4813-beb9-80c2f40fbec0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.120978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2dfd2-61cb-4813-beb9-80c2f40fbec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.154150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3fe2dfd2-61cb-4813-beb9-80c2f40fbec0 None None] MFA Rules not processed for user `4f13dae49d6b490cb7b86a611f09ebcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:45.155588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3fe2dfd2-61cb-4813-beb9-80c2f40fbec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:45.251871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 965/1909] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:45.256224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.296526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:45.384061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ce49-2d86-411b-a50e-8dc3bb183930 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:45.389628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:45.390710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.391620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.392303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.393290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.395300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.458268 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 945/1910] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:45 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:45.459503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2dfd2-61cb-4813-beb9-80c2f40fbec0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.473081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2dfd2-61cb-4813-beb9-80c2f40fbec0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:45.490197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:45.580685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:45.581378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.581667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.581942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.582654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.584633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.609240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 966/1911] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:45 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:45.610590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.622496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bf583-240b-403e-9a45-f68a5790fe53 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:45.627272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:45.627930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.628212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.628569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.629225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.630842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.643466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 946/1912] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:45.647639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.657805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328558-0b0a-4fa4-b06a-efc0ee2d8ed7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:45.662574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:45.663507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.663794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.664072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] PATH_INFO: `/v3/projects/70e20ca88aac4116afd29d96f027b291/users/e58233de99dc40c7aa328a75a41e882e/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.679871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e20ca88aac4116afd29d96f027b291, user_id=e58233de99dc40c7aa328a75a41e882e, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.683243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.696781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 967/1913] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:45 2022] PUT /identity/v3/projects/70e20ca88aac4116afd29d96f027b291/users/e58233de99dc40c7aa328a75a41e882e/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:45.704028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.718407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceefb53-139c-4e2f-8335-17350b9cd1fd admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:45.778243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a77e3-41dd-471d-85e6-a79919ff3167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:45.778946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a77e3-41dd-471d-85e6-a79919ff3167 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.779228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a77e3-41dd-471d-85e6-a79919ff3167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.779502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a77e3-41dd-471d-85e6-a79919ff3167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.780232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a77e3-41dd-471d-85e6-a79919ff3167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.781835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a77e3-41dd-471d-85e6-a79919ff3167 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.795521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 947/1914] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:45.796814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.807364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15584f59-baf9-4a99-bbb4-ad47c4b7a3d2 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:45.812138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:45.813033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.813316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.813600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] PATH_INFO: `/v3/projects/70e20ca88aac4116afd29d96f027b291/users/e58233de99dc40c7aa328a75a41e882e/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.815657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e20ca88aac4116afd29d96f027b291, user_id=e58233de99dc40c7aa328a75a41e882e, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:45.818282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:45.829756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 968/1915] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:45 2022] PUT /identity/v3/projects/70e20ca88aac4116afd29d96f027b291/users/e58233de99dc40c7aa328a75a41e882e/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:45.841545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e509-a28f-4c8f-96ae-80e8a64289f5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:45.841953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e509-a28f-4c8f-96ae-80e8a64289f5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:45.842402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e509-a28f-4c8f-96ae-80e8a64289f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:45.871956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4030e509-a28f-4c8f-96ae-80e8a64289f5 None None] MFA Rules not processed for user `e58233de99dc40c7aa328a75a41e882e`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:45.873502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4030e509-a28f-4c8f-96ae-80e8a64289f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:45.950394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 948/1916] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:45.961076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:45.963443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:46.045969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d80769-56ef-4382-b049-209b58e2b821 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:46.053307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17226c4-2f2a-4dc9-af52-e53000797591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:46.053972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17226c4-2f2a-4dc9-af52-e53000797591 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:46.054256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17226c4-2f2a-4dc9-af52-e53000797591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:46.054532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17226c4-2f2a-4dc9-af52-e53000797591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:46.123143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17226c4-2f2a-4dc9-af52-e53000797591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:46.124594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17226c4-2f2a-4dc9-af52-e53000797591 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:46.133844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 969/1917] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:47.387688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe25b-1d7e-4833-aa0a-56a4825c5cf2 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:47.388170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe25b-1d7e-4833-aa0a-56a4825c5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:47.388257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe25b-1d7e-4833-aa0a-56a4825c5cf2 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:47.389939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 949/1918] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:22:47.398329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:47.399223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:47.400549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:47.441828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:47.445901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:47.501204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:47.573640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 970/1919] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:47.589474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe25b-1d7e-4833-aa0a-56a4825c5cf2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:47.591635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-574fe25b-1d7e-4833-aa0a-56a4825c5cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:47.626933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe25b-1d7e-4833-aa0a-56a4825c5cf2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:47.644614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e959e2-471f-47c4-bdcf-6222a3790723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:47.644931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e959e2-471f-47c4-bdcf-6222a3790723 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:47.645478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e959e2-471f-47c4-bdcf-6222a3790723 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:47.645918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e959e2-471f-47c4-bdcf-6222a3790723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:47.669703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e959e2-471f-47c4-bdcf-6222a3790723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:47.671498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e959e2-471f-47c4-bdcf-6222a3790723 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:47.677395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:47.685251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 950/1920] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:49.842355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:49.844830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:49.943675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b8361-2857-471f-826e-6aeccb5f1215 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:49.949489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:49.950501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:49.950987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:49.951271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] PATH_INFO: `/v3/users/2505160f29584203bcce446891fc72e9` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:49.952531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2505160f29584203bcce446891fc72e9)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:49.954489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:50.018015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2505160f29584203bcce446891fc72e9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:50.035532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2505160f29584203bcce446891fc72e9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:50.036348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2505160f29584203bcce446891fc72e9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:50.037896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2505160f29584203bcce446891fc72e9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:50.046322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2505160f29584203bcce446891fc72e9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:50.067826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 971/1921] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:49 2022] DELETE /identity/v3/users/2505160f29584203bcce446891fc72e9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:50.072829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:50.073558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:50.073785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:50.101222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:50.102666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:50.194580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 951/1922] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:50.206609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:50.213662 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:50.260706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:50.338663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9778a4-a221-4505-865f-fb0c40df60f6 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:50.347016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:50.348206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:50.348495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:50.348900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:50.381314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:50.383045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:50.412750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 972/1923] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:50.990388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:50.991878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:51.076334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591795b7-eac4-4418-bdd5-51bcf7a2d796 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:51.080722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcf3a6-2d60-4e6d-8a12-230a5a37e279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:51.081388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcf3a6-2d60-4e6d-8a12-230a5a37e279 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:51.081676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcf3a6-2d60-4e6d-8a12-230a5a37e279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:51.081946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcf3a6-2d60-4e6d-8a12-230a5a37e279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:51.083766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ebbcf3a6-2d60-4e6d-8a12-230a5a37e279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:51.154061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcf3a6-2d60-4e6d-8a12-230a5a37e279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:51.155590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcf3a6-2d60-4e6d-8a12-230a5a37e279 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:51.169633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 952/1924] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:51.613008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:51.616156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:51.674960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3228b-648a-4ed6-99ee-a4da7615c69b service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:51.689875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:51.693142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:51.694070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:51.694070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] PATH_INFO: `/v3/projects/3ffb0dd5f1f342ad9f2eacfb8dac4fad` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:51.697447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffb0dd5f1f342ad9f2eacfb8dac4fad)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:51.707553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:51.795799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffb0dd5f1f342ad9f2eacfb8dac4fad', 'request_id': 'req-8948e6e4-2109-46b1-a054-ae18f784655c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:51.813428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffb0dd5f1f342ad9f2eacfb8dac4fad', 'request_id': 'req-8948e6e4-2109-46b1-a054-ae18f784655c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:51.823585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffb0dd5f1f342ad9f2eacfb8dac4fad', 'request_id': 'req-8948e6e4-2109-46b1-a054-ae18f784655c'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:51.838322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] The token cache is being invalidate because project 3ffb0dd5f1f342ad9f2eacfb8dac4fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:51.839185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:51.840035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:51.841842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 973/1925] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:51 2022] DELETE /identity/v3/projects/3ffb0dd5f1f342ad9f2eacfb8dac4fad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:51.850514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:51.851084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:51.851376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:51.851657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:51.852040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:51.892865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:51.894099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:51.955377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:51.982531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 953/1926] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:51.984108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948e6e4-2109-46b1-a054-ae18f784655c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:51.987671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:51.994978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:51.995985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:51.997234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:51.998259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:51.998956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] PATH_INFO: `/v3/users/6f010abeba0347c6bc43e800c1935e02` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.001857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f010abeba0347c6bc43e800c1935e02)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.004282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.018352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991cd47-e80c-4b0c-8ff8-f2f9470f7816 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.023878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.025307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.025592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.025878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] PATH_INFO: `/v3/users/81d55f4f3fea4d2ea838f42310a91480` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.027163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d55f4f3fea4d2ea838f42310a91480)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.029115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.089212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f010abeba0347c6bc43e800c1935e02'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.103698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d55f4f3fea4d2ea838f42310a91480'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.104353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:52.115422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f010abeba0347c6bc43e800c1935e02'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.116644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f010abeba0347c6bc43e800c1935e02'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.117576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f010abeba0347c6bc43e800c1935e02'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.120382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d55f4f3fea4d2ea838f42310a91480'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.121415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d55f4f3fea4d2ea838f42310a91480'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.122184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d55f4f3fea4d2ea838f42310a91480'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.132119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-63cfb870-7497-4519-a006-174b4c1c31d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f010abeba0347c6bc43e800c1935e02'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.135696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-25c83e3b-29ae-4a61-94ca-602f00ecf31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d55f4f3fea4d2ea838f42310a91480'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:52.154949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 954/1927] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:51 2022] DELETE /identity/v3/users/81d55f4f3fea4d2ea838f42310a91480 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:52.156668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2e9a4-5d8c-4753-b0bf-3de2d6eed329 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.157064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 974/1928] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:51 2022] DELETE /identity/v3/users/6f010abeba0347c6bc43e800c1935e02 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:52.159889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2e9a4-5d8c-4753-b0bf-3de2d6eed329 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.159889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2e9a4-5d8c-4753-b0bf-3de2d6eed329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.161907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690664-02d0-44cc-8cab-5418ce3084f1 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.162150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690664-02d0-44cc-8cab-5418ce3084f1 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.162468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690664-02d0-44cc-8cab-5418ce3084f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.194313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5af2e9a4-5d8c-4753-b0bf-3de2d6eed329 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:52.196152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ee690664-02d0-44cc-8cab-5418ce3084f1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:52.196320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5af2e9a4-5d8c-4753-b0bf-3de2d6eed329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:52.197710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ee690664-02d0-44cc-8cab-5418ce3084f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:52.272252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 975/1929] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:52.273658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.273951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.274232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.277924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 955/1930] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:52.282269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2e9a4-5d8c-4753-b0bf-3de2d6eed329 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.291642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2e9a4-5d8c-4753-b0bf-3de2d6eed329 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.294172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:52.295563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:52.296401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.297066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.297353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.297632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.298360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:52.298669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.300387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.303564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 976/1931] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:52.307531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.308969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:52.317248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 956/1932] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:22:52.317248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.317248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:52.370643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c48dce-c50d-40bf-ac29-d76fbc587095 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.374306 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.374991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.375209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:52.375334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.375539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.379745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3a4c6-a636-401f-9f70-0c257858f36e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.385383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.386082 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.386424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.386612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.387093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.388068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.397450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.398500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 977/1933] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:52.399002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.403922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.410387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 957/1934] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:52.413536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc7079-eee8-4794-91c0-af485b502f94 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.418343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.419057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.419337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.420094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.420299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.422203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.449905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 978/1935] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:52 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:52.454132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.464594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275370-3cb9-46bd-b64f-4e0eb3785248 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.531821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.532810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.532810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.533073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.533798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.536005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.561549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 958/1936] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:52 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:52.566003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.578926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb56aed-480c-43be-b71c-69cb31ff7a8a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.584624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.585514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.585844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.586222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.587127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.589117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.604123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 979/1937] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:52.608234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.619525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afae0-8d50-4abe-a6a5-80c045e168fd admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.624747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0543910-1e76-4970-b5cc-e0b355cfca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.625438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543910-1e76-4970-b5cc-e0b355cfca27 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.625786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543910-1e76-4970-b5cc-e0b355cfca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.626025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0543910-1e76-4970-b5cc-e0b355cfca27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.626849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0543910-1e76-4970-b5cc-e0b355cfca27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.628423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0543910-1e76-4970-b5cc-e0b355cfca27 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.643109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 959/1938] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:52.644297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.655230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920ff9a-2fbd-4b9e-87bc-4d65a6f9ef0f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:52.659837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:52.660748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.661031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.661383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] PATH_INFO: `/v3/projects/7dbebf92933e4bf6a695be05c4e8a96a/users/d4070271d5e348beb533687e36b5e408/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.677452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbebf92933e4bf6a695be05c4e8a96a, user_id=d4070271d5e348beb533687e36b5e408, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:52.686888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:52.709137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 980/1939] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:52 2022] PUT /identity/v3/projects/7dbebf92933e4bf6a695be05c4e8a96a/users/d4070271d5e348beb533687e36b5e408/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:52.721798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:52.722498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:52.723072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:52.768411 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] MFA Rules not processed for user `d4070271d5e348beb533687e36b5e408`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:52.770398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:52.921075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 960/1940] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:52.934221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:52.936805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:52.966834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:53.100894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:53.103752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:53.108042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ef56-7cb0-420a-8eee-490b7959b30f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:53.126461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40a1f11c5cd4b48be27dd1a0f48bdc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:53.126461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:53.126461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:53.126461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:53.157930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:53.163488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:53.208181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 981/1941] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:53.209636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:53.215456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:53.296776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70994797-cdff-46cf-af08-1b34742e0b79 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:53.303588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:53.304884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:53.306664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:53.307025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] PATH_INFO: `/v3/projects/82b32c43bfc24574afcbc3610b2b072b` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:53.310571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b32c43bfc24574afcbc3610b2b072b)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:53.313615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:53.316207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:53.409686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802cf7c-cde3-4dde-a4c7-21d96019533d service glance] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:53.423689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:53.425149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:53.425461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:53.425758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] PATH_INFO: `/v3/projects/a132fe724bad40179171739350bbab0e` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:53.429619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a132fe724bad40179171739350bbab0e)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:53.432117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:53.554744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b32c43bfc24574afcbc3610b2b072b', 'request_id': 'req-7c504805-f4ed-42fa-9de2-1debc838d120'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.581220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b32c43bfc24574afcbc3610b2b072b', 'request_id': 'req-7c504805-f4ed-42fa-9de2-1debc838d120'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.595189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b32c43bfc24574afcbc3610b2b072b', 'request_id': 'req-7c504805-f4ed-42fa-9de2-1debc838d120'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.650169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a132fe724bad40179171739350bbab0e', 'request_id': 'req-1f609b19-0a4f-441f-83bb-21474c574e8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.671429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a132fe724bad40179171739350bbab0e', 'request_id': 'req-1f609b19-0a4f-441f-83bb-21474c574e8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.681462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] The token cache is being invalidate because project 82b32c43bfc24574afcbc3610b2b072b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:53.683138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.684747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.693422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 961/1942] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:53 2022] DELETE /identity/v3/projects/82b32c43bfc24574afcbc3610b2b072b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:53.693590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a132fe724bad40179171739350bbab0e', 'request_id': 'req-1f609b19-0a4f-441f-83bb-21474c574e8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.695097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:53.697798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:53.722594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] The token cache is being invalidate because project a132fe724bad40179171739350bbab0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:53.723126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.725818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:53.733265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 982/1943] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:53 2022] DELETE /identity/v3/projects/a132fe724bad40179171739350bbab0e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:53.745431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:53.752537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:53.809801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c504805-f4ed-42fa-9de2-1debc838d120 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:53.882716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:53.883698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:53.884774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:53.885019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] PATH_INFO: `/v3/users/5fa64c48e1b443338d6d45dc9ad41107` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:53.886729 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa64c48e1b443338d6d45dc9ad41107)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:53.889119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:53.925296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:53.949402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f609b19-0a4f-441f-83bb-21474c574e8e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:53.964568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:53.965185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:53.966040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:53.966040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:53.966325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] PATH_INFO: `/v3/users/bad5da2abff344acb32a4456b987a317` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:53.971800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad5da2abff344acb32a4456b987a317)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:53.976286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:53.983864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa64c48e1b443338d6d45dc9ad41107'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.012434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa64c48e1b443338d6d45dc9ad41107'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.013902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa64c48e1b443338d6d45dc9ad41107'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.014987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa64c48e1b443338d6d45dc9ad41107'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.029429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa64c48e1b443338d6d45dc9ad41107'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.045367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad5da2abff344acb32a4456b987a317'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.051902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 962/1944] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:53 2022] DELETE /identity/v3/users/5fa64c48e1b443338d6d45dc9ad41107 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:54.066389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad5da2abff344acb32a4456b987a317'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.067258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad5da2abff344acb32a4456b987a317'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.068030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad5da2abff344acb32a4456b987a317'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.079471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad5da2abff344acb32a4456b987a317'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:54.101515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 983/1945] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:53 2022] DELETE /identity/v3/users/bad5da2abff344acb32a4456b987a317 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:54.669878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:54.671591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:54.726524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:54.728739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:54.810742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbb3b-a067-4673-a36a-4e1a7156861c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:54.851168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4f230-dc1a-4e22-ac07-46a4a7fa6c74 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:54.856351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:54.857226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:54.857512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:54.858063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] PATH_INFO: `/v3/projects/d8d0cb06fc49463ea89e7a9e516f9954` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:54.859634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d0cb06fc49463ea89e7a9e516f9954)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:54.862083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:54.942506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:54.951212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:54.951526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:54.951788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] PATH_INFO: `/v3/projects/7682038b798d47f694754ec4ff70667b` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:54.953224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7682038b798d47f694754ec4ff70667b)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:54.955241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:54.982845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d0cb06fc49463ea89e7a9e516f9954', 'request_id': 'req-90baf9b1-652c-4bc5-8517-250767b9e7f8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.005241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d0cb06fc49463ea89e7a9e516f9954', 'request_id': 'req-90baf9b1-652c-4bc5-8517-250767b9e7f8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.024048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d0cb06fc49463ea89e7a9e516f9954', 'request_id': 'req-90baf9b1-652c-4bc5-8517-250767b9e7f8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.038814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7682038b798d47f694754ec4ff70667b', 'request_id': 'req-310aace8-879a-4642-bc73-88eb105fa193'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.050827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7682038b798d47f694754ec4ff70667b', 'request_id': 'req-310aace8-879a-4642-bc73-88eb105fa193'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.060294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:55.070496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] The token cache is being invalidate because project d8d0cb06fc49463ea89e7a9e516f9954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:55.071394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.072944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-90baf9b1-652c-4bc5-8517-250767b9e7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.073399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7682038b798d47f694754ec4ff70667b', 'request_id': 'req-310aace8-879a-4642-bc73-88eb105fa193'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.075879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 984/1946] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:54 2022] DELETE /identity/v3/projects/d8d0cb06fc49463ea89e7a9e516f9954 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:55.082646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b12b-2d76-424a-86a6-ba0ab9db184a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.082980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b12b-2d76-424a-86a6-ba0ab9db184a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.083430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82b12b-2d76-424a-86a6-ba0ab9db184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.089992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:55.103854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] The token cache is being invalidate because project 7682038b798d47f694754ec4ff70667b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:55.104495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.105970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-310aace8-879a-4642-bc73-88eb105fa193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:55.110851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 963/1947] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:54 2022] DELETE /identity/v3/projects/7682038b798d47f694754ec4ff70667b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:55.112218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-cd82b12b-2d76-424a-86a6-ba0ab9db184a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:55.113599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cd82b12b-2d76-424a-86a6-ba0ab9db184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:55.115378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10aebc-d299-46ef-8f2f-a19aabf867c5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.115591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10aebc-d299-46ef-8f2f-a19aabf867c5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.116171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10aebc-d299-46ef-8f2f-a19aabf867c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.159723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8a10aebc-d299-46ef-8f2f-a19aabf867c5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:55.162136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8a10aebc-d299-46ef-8f2f-a19aabf867c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:55.239385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 985/1948] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:55.247573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90402ce8-d62e-4f91-bbb3-dbe321f2a196 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.248189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90402ce8-d62e-4f91-bbb3-dbe321f2a196 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.248691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90402ce8-d62e-4f91-bbb3-dbe321f2a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.285206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-90402ce8-d62e-4f91-bbb3-dbe321f2a196 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:55.285206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-90402ce8-d62e-4f91-bbb3-dbe321f2a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:55.294734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 986/1949] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:55.299209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90402ce8-d62e-4f91-bbb3-dbe321f2a196 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.311757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90402ce8-d62e-4f91-bbb3-dbe321f2a196 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.317330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 964/1950] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:55.324287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.324901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.325184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.325459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.325580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab9f6-8431-4760-bd0a-4a805f7584fc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.325870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab9f6-8431-4760-bd0a-4a805f7584fc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.326149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab9f6-8431-4760-bd0a-4a805f7584fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.326257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:55.326488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.328213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.350106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 987/1951] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:22:55.354121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.361555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-e85ab9f6-8431-4760-bd0a-4a805f7584fc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:55.363978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e85ab9f6-8431-4760-bd0a-4a805f7584fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:55.376548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 965/1952] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:55.390074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5572bf-a639-46c3-a279-fb60901b287a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.390307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ab9f6-8431-4760-bd0a-4a805f7584fc None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.405485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ab9f6-8431-4760-bd0a-4a805f7584fc None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.405688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.406039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.406325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.406604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.407370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.409263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.416840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.418267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.422169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.422788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.424608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:55.425128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.438461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.465294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 966/1953] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:22:55.471249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.482794 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 988/1954] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:55.490732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.512524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762204cc-5f02-4252-8eeb-5487c9c1eafa admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.631727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920ca6-51de-4b2b-9bee-b529d0828f8a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.661388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.662667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.663309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.663906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.666194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.670245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.702747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 989/1955] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/users => generated 279 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:55.706127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.714250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.715584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.715877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.716155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.716908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.719222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.740071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b809f22-01f1-44c7-9e2c-aae51679672b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.758014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.759772 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.760075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.761068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.762872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.765032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.769041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 967/1956] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/projects => generated 371 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:55.773549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.786336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 990/1957] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:55.787726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.808165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd31d34-313d-4175-b1ec-8f9c393d0c55 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.861900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:55.908137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b8dc-34ca-41a5-89a6-669b004d0329 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.916012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.917147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.918221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.918221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.919375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.923422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.931351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.932362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.932710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.933339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.933987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:55.935215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.937110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:55.958629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 991/1958] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:55.960267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.968244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 968/1959] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:55 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:55.969258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:55.980971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d763a2-9b12-4dee-a8b7-542df05511d4 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.987095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993216d2-613d-45bc-989b-dca7ba8d7272 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:55.993008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.994397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.995130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:55.995573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:55.996635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:55.997410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51053b2-55b7-4379-9e77-6b31276e1e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:55.998630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51053b2-55b7-4379-9e77-6b31276e1e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:55.999210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.000306 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51053b2-55b7-4379-9e77-6b31276e1e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.000872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51053b2-55b7-4379-9e77-6b31276e1e64 admin admin] PATH_INFO: `/v3/projects/0df797f4b3f54518932e9d303ce78c24/users/6b6a03e40f374c688fb9b2fb3119af21/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.035259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 969/1960] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:56.039489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51053b2-55b7-4379-9e77-6b31276e1e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df797f4b3f54518932e9d303ce78c24, user_id=6b6a03e40f374c688fb9b2fb3119af21, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:56.044995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:56.045223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51053b2-55b7-4379-9e77-6b31276e1e64 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.059272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ed1e0-700a-43c4-a009-8273ee007b8f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:56.067140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:56.068398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.069473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.070086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.071213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:56.074848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.085819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 992/1961] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:55 2022] PUT /identity/v3/projects/0df797f4b3f54518932e9d303ce78c24/users/6b6a03e40f374c688fb9b2fb3119af21/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:56.098011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.098438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.098754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.101763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 970/1962] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:56.103287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:56.127364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e5b5-d0b8-4244-a476-224622d9c0df admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:56.143927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] MFA Rules not processed for user `6b6a03e40f374c688fb9b2fb3119af21`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:56.146631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:56.224875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b12762-1f80-456b-b1a8-dade224606fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:56.225944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12762-1f80-456b-b1a8-dade224606fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.226173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12762-1f80-456b-b1a8-dade224606fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.226589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b12762-1f80-456b-b1a8-dade224606fa admin admin] PATH_INFO: `/v3/projects/745706ce37a542d8b36eb25facd0e137/users/3f2e877acbb14c40a0f09e608f1c01ef/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.249873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 993/1963] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:56.273148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b12762-1f80-456b-b1a8-dade224606fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=745706ce37a542d8b36eb25facd0e137, user_id=3f2e877acbb14c40a0f09e608f1c01ef, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:56.276911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b12762-1f80-456b-b1a8-dade224606fa admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.283386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:56.285938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:56.293692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 971/1964] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:56 2022] PUT /identity/v3/projects/745706ce37a542d8b36eb25facd0e137/users/3f2e877acbb14c40a0f09e608f1c01ef/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:56.316741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd367f38-18f2-4747-b5a2-066575382190 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.317179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd367f38-18f2-4747-b5a2-066575382190 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.317471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd367f38-18f2-4747-b5a2-066575382190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.360859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-dd367f38-18f2-4747-b5a2-066575382190 None None] MFA Rules not processed for user `3f2e877acbb14c40a0f09e608f1c01ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:56.362409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dd367f38-18f2-4747-b5a2-066575382190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:56.418308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2275-0e47-48e5-87f8-933e95339ca2 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:56.486745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 972/1965] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:56.490883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd367f38-18f2-4747-b5a2-066575382190 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:56.519461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:56.520446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.522000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.522599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.544471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:56.616980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:56.651235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd367f38-18f2-4747-b5a2-066575382190 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:56.659310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:56.660006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.660598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.660752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.665715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:56.676234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.676614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:56.676614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.691566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 994/1966] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:56 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:56.709693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:56.724796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65572797-8cb8-453f-bd21-5351dabce799 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:56.730945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:56.731074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 973/1967] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:56 2022] POST /identity/v3/projects => generated 371 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:56.731582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.731860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.732135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] PATH_INFO: `/v3/users/6b6a03e40f374c688fb9b2fb3119af21` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.733745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6a03e40f374c688fb9b2fb3119af21)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:56.734552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:56.735721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.797888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6a03e40f374c688fb9b2fb3119af21'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:56.820158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6a03e40f374c688fb9b2fb3119af21'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:56.822490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6a03e40f374c688fb9b2fb3119af21'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:56.824382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6a03e40f374c688fb9b2fb3119af21'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:56.827822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120b440-562f-4452-961a-f4ba22b78261 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:56.835829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6a03e40f374c688fb9b2fb3119af21'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:56.858383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 995/1968] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:56 2022] DELETE /identity/v3/users/6b6a03e40f374c688fb9b2fb3119af21 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:56.859678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:56.861443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:56.862254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c53dbc-a7b8-4de6-b38a-b3cfe4979908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:56.863409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c53dbc-a7b8-4de6-b38a-b3cfe4979908 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.864154 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c53dbc-a7b8-4de6-b38a-b3cfe4979908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.864657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c53dbc-a7b8-4de6-b38a-b3cfe4979908 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.865567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c53dbc-a7b8-4de6-b38a-b3cfe4979908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:56.867836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c53dbc-a7b8-4de6-b38a-b3cfe4979908 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:56.899507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 974/1969] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:56 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:22:56.901331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.901866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.902444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.936750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:56.937805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:56.989628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc81c7c-8838-468e-bdd6-af12d9404054 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:56.995280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:56.996181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:56.996467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:56.996749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] PATH_INFO: `/v3/users/4f13dae49d6b490cb7b86a611f09ebcc` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:56.998438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f13dae49d6b490cb7b86a611f09ebcc)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:57.000591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:57.021229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 975/1970] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:57.023433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:57.032039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:57.036570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.057919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5d3a9-aca6-4b5f-ba3d-798ab237f6fa None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:57.064844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:57.066005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.066380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.067560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.069544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:57.071816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:57.083809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f13dae49d6b490cb7b86a611f09ebcc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:57.097046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 976/1971] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:57.097764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:57.101505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.111720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f13dae49d6b490cb7b86a611f09ebcc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:57.112635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f13dae49d6b490cb7b86a611f09ebcc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:57.113394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f13dae49d6b490cb7b86a611f09ebcc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:57.124860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f13dae49d6b490cb7b86a611f09ebcc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:57.152472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 996/1972] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:56 2022] DELETE /identity/v3/users/4f13dae49d6b490cb7b86a611f09ebcc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:57.152472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:57.154097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.201723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:57.232089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03b44-a06c-4a5a-9d35-d072cc5836e8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:57.299252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295c1c7-98bf-4e76-a476-7e43e1bb48d1 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:57.307731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8af1e-a25a-464b-8ba0-61b1d04fdab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:57.308652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8af1e-a25a-464b-8ba0-61b1d04fdab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.308943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8af1e-a25a-464b-8ba0-61b1d04fdab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.309227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8af1e-a25a-464b-8ba0-61b1d04fdab6 admin admin] PATH_INFO: `/v3/projects/58d33495cdad426395cfb88ba3fcfb1d/users/4b57e9f77837452384148b23283c3e3e/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.326089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:57.326837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.327126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.327393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.329636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.334125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8af1e-a25a-464b-8ba0-61b1d04fdab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d33495cdad426395cfb88ba3fcfb1d, user_id=4b57e9f77837452384148b23283c3e3e, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:57.339743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8af1e-a25a-464b-8ba0-61b1d04fdab6 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:57.345681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:57.347425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:57.353530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 997/1973] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:57 2022] PUT /identity/v3/projects/58d33495cdad426395cfb88ba3fcfb1d/users/4b57e9f77837452384148b23283c3e3e/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:57.354615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.355061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.355262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.374211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 977/1974] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:57.375860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:57.380028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:57.382274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.389282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d01da-657b-408e-95f2-be0d2352d630 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:57.480535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:57.481447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.481621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.482113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.482953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:57.490894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:57.497241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 998/1975] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:57.510884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 978/1976] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:57.511216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:57.513069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.523600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:57.538877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e68dcf-d82a-4c97-bb3a-6d1e6a6c44a4 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:57.546571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94e5c7-fbe2-40b3-926a-abecdc4549a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:57.547998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e5c7-fbe2-40b3-926a-abecdc4549a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.548352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e5c7-fbe2-40b3-926a-abecdc4549a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.548697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94e5c7-fbe2-40b3-926a-abecdc4549a2 admin admin] PATH_INFO: `/v3/projects/58d33495cdad426395cfb88ba3fcfb1d/users/4b57e9f77837452384148b23283c3e3e/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.551238 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94e5c7-fbe2-40b3-926a-abecdc4549a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d33495cdad426395cfb88ba3fcfb1d, user_id=4b57e9f77837452384148b23283c3e3e, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:57.554350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94e5c7-fbe2-40b3-926a-abecdc4549a2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:57.559695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:57.574742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 979/1977] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:57 2022] PUT /identity/v3/projects/58d33495cdad426395cfb88ba3fcfb1d/users/4b57e9f77837452384148b23283c3e3e/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:57.582463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.582953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.583420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.665959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] MFA Rules not processed for user `4b57e9f77837452384148b23283c3e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:57.667228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.670396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89faad-00cb-41e3-bf5d-8e3af9734b67 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:57.825168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:57.825833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:57.826126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:57.826411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:57.889115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 980/1978] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:57.891356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:57.892922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:57.919615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:57.980366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:57.982284 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.009377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 999/1979] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:58.010362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.014144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:58.046982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e201bab-5d5c-4e90-ad76-20c229144933 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.052853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.053789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.054075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.054352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] PATH_INFO: `/v3/projects/0df797f4b3f54518932e9d303ce78c24` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.056301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df797f4b3f54518932e9d303ce78c24)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.058713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.125935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da7111-155b-4601-b3e2-fea408164908 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.130234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df797f4b3f54518932e9d303ce78c24', 'request_id': 'req-f9a3e3b1-ff47-4ce5-8867-54625ae97611'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.140716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df797f4b3f54518932e9d303ce78c24', 'request_id': 'req-f9a3e3b1-ff47-4ce5-8867-54625ae97611'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.150425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df797f4b3f54518932e9d303ce78c24', 'request_id': 'req-f9a3e3b1-ff47-4ce5-8867-54625ae97611'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.179742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] The token cache is being invalidate because project 0df797f4b3f54518932e9d303ce78c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:58.180155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.181393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9a3e3b1-ff47-4ce5-8867-54625ae97611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.188075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 981/1980] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:57 2022] DELETE /identity/v3/projects/0df797f4b3f54518932e9d303ce78c24 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:58.189582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea4be-6c0b-4786-abfb-b21059dfd78f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.189870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea4be-6c0b-4786-abfb-b21059dfd78f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.190620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:58.191366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea4be-6c0b-4786-abfb-b21059dfd78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.204598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.205942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.206358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.206712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.209291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:58.234515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0fbea4be-6c0b-4786-abfb-b21059dfd78f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:58.235756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0fbea4be-6c0b-4786-abfb-b21059dfd78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:58.308830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.310350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.318766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 982/1981] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:58.330733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e939c-feda-401e-9d43-4ad32ac69a2f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.331015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e939c-feda-401e-9d43-4ad32ac69a2f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.331416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e939c-feda-401e-9d43-4ad32ac69a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.334783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1000/1982] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:58.358431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-166e939c-feda-401e-9d43-4ad32ac69a2f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:58.361049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-166e939c-feda-401e-9d43-4ad32ac69a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:58.382340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 983/1983] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:58.383208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.396103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb687-c5bb-41f4-9fea-69de230fb99e service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.402345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.403536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.404021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.404712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.405458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:22:58.405769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.407435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.431324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1001/1984] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:22:58.433068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e939c-feda-401e-9d43-4ad32ac69a2f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.445336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e939c-feda-401e-9d43-4ad32ac69a2f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.454175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.455702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.455852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.456207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.457019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.459157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.505442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 984/1985] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:22:58 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:58.511234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.528056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc897463-f2be-4cf1-9ab4-f24ded55fc84 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.557117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.557117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:58.591843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:58.631414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.632069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.632353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.632629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.633571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.638272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.670178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1002/1986] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:22:58 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:22:58.673962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.690374 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126629d-ac53-438a-a142-5657861900ea admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.699286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.700350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.700840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.701313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.702408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.704425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.726597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba55e6-69f5-4e11-9660-a5b08cb3fd9e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.734963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.735858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.736251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.736518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] PATH_INFO: `/v3/projects/a205fdafc0f246dbb3cdc9e568aff058` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.739894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a205fdafc0f246dbb3cdc9e568aff058)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.741956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.748372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1003/1987] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:22:58.752617 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.771494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8355f-1979-4d9a-9e0a-553004ea2105 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.780572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.781751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.782536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.783051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.784740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.786889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.801605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1004/1988] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:22:58.809019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.830307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ebaeb-6b97-43f8-8bb0-16335dc7a2d9 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:58.842616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09a463-5969-484d-8625-0e7565da7d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:58.844671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09a463-5969-484d-8625-0e7565da7d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.845032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09a463-5969-484d-8625-0e7565da7d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.846063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09a463-5969-484d-8625-0e7565da7d94 admin admin] PATH_INFO: `/v3/projects/28124a417dc443aca95f3edd11697c05/users/87836624f7254574b5404fef6cf55d26/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.872894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a205fdafc0f246dbb3cdc9e568aff058', 'request_id': 'req-e68442cd-9d18-41d2-bedf-057e12a3e5b3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.885026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09a463-5969-484d-8625-0e7565da7d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28124a417dc443aca95f3edd11697c05, user_id=87836624f7254574b5404fef6cf55d26, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:58.885026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09a463-5969-484d-8625-0e7565da7d94 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:58.889898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a205fdafc0f246dbb3cdc9e568aff058', 'request_id': 'req-e68442cd-9d18-41d2-bedf-057e12a3e5b3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.901301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a205fdafc0f246dbb3cdc9e568aff058', 'request_id': 'req-e68442cd-9d18-41d2-bedf-057e12a3e5b3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.913375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1005/1989] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:22:58 2022] PUT /identity/v3/projects/28124a417dc443aca95f3edd11697c05/users/87836624f7254574b5404fef6cf55d26/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:58.918999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:58.919463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:58.919884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:58.958922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] The token cache is being invalidate because project a205fdafc0f246dbb3cdc9e568aff058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:22:58.959220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.959893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:58.961647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 985/1990] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:58 2022] DELETE /identity/v3/projects/a205fdafc0f246dbb3cdc9e568aff058 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:22:58.963883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:58.965512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:58.965660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:58.967042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:58.986900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:59.062838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1006/1991] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:22:59.064198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:59.068908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:59.075245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68442cd-9d18-41d2-bedf-057e12a3e5b3 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:59.081895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:59.083184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958041ba-2997-447c-9631-7d0ff1762ed0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:59.084011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:59.084446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:59.084886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] PATH_INFO: `/v3/users/3f2e877acbb14c40a0f09e608f1c01ef` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:59.087777 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2e877acbb14c40a0f09e608f1c01ef)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:59.089897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:59.090141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:59.091008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:59.091397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:59.091818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] PATH_INFO: `/v3/users/e58233de99dc40c7aa328a75a41e882e` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:59.095184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58233de99dc40c7aa328a75a41e882e)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:59.097743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:59.164183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:22:59.176089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2e877acbb14c40a0f09e608f1c01ef'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.182633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58233de99dc40c7aa328a75a41e882e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.194162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2e877acbb14c40a0f09e608f1c01ef'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.195398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2e877acbb14c40a0f09e608f1c01ef'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.196097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2e877acbb14c40a0f09e608f1c01ef'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.205123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58233de99dc40c7aa328a75a41e882e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.206541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2e877acbb14c40a0f09e608f1c01ef'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.206668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58233de99dc40c7aa328a75a41e882e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.207445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58233de99dc40c7aa328a75a41e882e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.223745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0b811a41-53e6-4a09-aae6-eda7bcfc9e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58233de99dc40c7aa328a75a41e882e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:22:59.230373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 986/1992] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:58 2022] DELETE /identity/v3/users/3f2e877acbb14c40a0f09e608f1c01ef => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:59.230373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:59.230373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:59.250971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1007/1993] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:22:59 2022] DELETE /identity/v3/users/e58233de99dc40c7aa328a75a41e882e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:22:59.250971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:59.250971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:59.251965 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:59.290958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:22:59.295447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:59.309212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5d096-6360-4dbe-a164-f3bbd2a0c7cd admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:59.377973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34177c61-9c27-4d24-96b3-c2d15798b040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:59.380184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34177c61-9c27-4d24-96b3-c2d15798b040 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:59.380184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34177c61-9c27-4d24-96b3-c2d15798b040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:59.380545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34177c61-9c27-4d24-96b3-c2d15798b040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:59.382866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-34177c61-9c27-4d24-96b3-c2d15798b040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:59.426902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1008/1994] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:22:59.440678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:59.443049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:59.468387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47018-5f57-4efe-bf22-50615e76125b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:59.473502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:59.474341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:59.474763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:59.475145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:59.486831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:59.488656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:59.504970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1009/1995] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:22:59.520734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34177c61-9c27-4d24-96b3-c2d15798b040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:59.522427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34177c61-9c27-4d24-96b3-c2d15798b040 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:22:59.535735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 987/1996] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:22:59.883282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:22:59.887881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:22:59.951548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55633b3b-e5da-465c-a084-ea008b741a04 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:22:59.971397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:22:59.972960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:22:59.973591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:22:59.974188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] PATH_INFO: `/v3/projects/70e20ca88aac4116afd29d96f027b291` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:22:59.976063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e20ca88aac4116afd29d96f027b291)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:22:59.979489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.016915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:00.111235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e20ca88aac4116afd29d96f027b291', 'request_id': 'req-1c5408c5-a29a-469d-809f-4027f4667361'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:00.122982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e20ca88aac4116afd29d96f027b291', 'request_id': 'req-1c5408c5-a29a-469d-809f-4027f4667361'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:00.142334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e20ca88aac4116afd29d96f027b291', 'request_id': 'req-1c5408c5-a29a-469d-809f-4027f4667361'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:00.181485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] The token cache is being invalidate because project 70e20ca88aac4116afd29d96f027b291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:00.181785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:00.182493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1c5408c5-a29a-469d-809f-4027f4667361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:00.184740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1010/1997] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:22:59 2022] DELETE /identity/v3/projects/70e20ca88aac4116afd29d96f027b291 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:00.190480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b905e5-f850-49fb-a4c4-55f9ac149ca3 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.191038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b905e5-f850-49fb-a4c4-55f9ac149ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.191127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b905e5-f850-49fb-a4c4-55f9ac149ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.214560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-45b905e5-f850-49fb-a4c4-55f9ac149ca3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:00.216136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-45b905e5-f850-49fb-a4c4-55f9ac149ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:00.266118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:00.313847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 988/1998] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:00.327021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b548d1-4fcf-4ba1-8f34-a3623be43db3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.327316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b548d1-4fcf-4ba1-8f34-a3623be43db3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.327588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b548d1-4fcf-4ba1-8f34-a3623be43db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.358302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b6b548d1-4fcf-4ba1-8f34-a3623be43db3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:00.360049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b6b548d1-4fcf-4ba1-8f34-a3623be43db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:00.369664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1011/1999] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:00.374101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b905e5-f850-49fb-a4c4-55f9ac149ca3 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:00.385637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b905e5-f850-49fb-a4c4-55f9ac149ca3 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:00.391070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:00.391767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.392045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.392305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.393038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:00.393349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:00.395384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.419213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 989/2000] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:00.423433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b548d1-4fcf-4ba1-8f34-a3623be43db3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:00.433529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b548d1-4fcf-4ba1-8f34-a3623be43db3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:00.439382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:00.440337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.440536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.440925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.441764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:00.443927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.509877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1012/2001] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:00 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:00.514590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:00.533541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6de7c-71f1-4cab-a02a-2f500fb23572 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:00.657351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:00.658164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.658517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.659294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.659948 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:00.662945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.708017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 990/2002] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:00 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:00.713489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:00.733651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872b9b-de82-4922-bec8-e8626a536b1b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:00.738862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:00.739614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.739899 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.740180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.740828 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:00.740969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:00.745012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.746028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:00.765032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1013/2003] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:00.769153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:00.787402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc02475-f319-4913-95d0-9914aa9d5036 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:00.799961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:00.801180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.801591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.802038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.803187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:00.808553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.824104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a39f3-6eae-4197-ad90-15a7c331d2e7 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:00.831295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:00.832599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.833377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.833830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] PATH_INFO: `/v3/projects/745706ce37a542d8b36eb25facd0e137` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.843056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1014/2004] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:00.844302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=745706ce37a542d8b36eb25facd0e137)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:00.847882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:00.860341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.871364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7269-2b8c-454e-920c-02e1d56d2951 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:00.883510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7d17b-f90d-40e5-bbb9-aa61e400cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:00.885827 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d17b-f90d-40e5-bbb9-aa61e400cbde admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.886399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d17b-f90d-40e5-bbb9-aa61e400cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.886889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d17b-f90d-40e5-bbb9-aa61e400cbde admin admin] PATH_INFO: `/v3/projects/1515d95a5c1843ef909db1d059da09e1/users/8eed7ed531f24e60b0ef1e106980f79f/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:00.942720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7d17b-f90d-40e5-bbb9-aa61e400cbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=1515d95a5c1843ef909db1d059da09e1, user_id=8eed7ed531f24e60b0ef1e106980f79f, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:00.946027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7d17b-f90d-40e5-bbb9-aa61e400cbde admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:00.976277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745706ce37a542d8b36eb25facd0e137', 'request_id': 'req-ea871593-ed05-4b0c-be5e-f75ee335ca19'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:00.977561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1015/2005] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:00 2022] PUT /identity/v3/projects/1515d95a5c1843ef909db1d059da09e1/users/8eed7ed531f24e60b0ef1e106980f79f/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:00.997669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:00.998201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:00.998906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:01.002573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745706ce37a542d8b36eb25facd0e137', 'request_id': 'req-ea871593-ed05-4b0c-be5e-f75ee335ca19'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.039900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745706ce37a542d8b36eb25facd0e137', 'request_id': 'req-ea871593-ed05-4b0c-be5e-f75ee335ca19'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.065065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] The token cache is being invalidate because project 745706ce37a542d8b36eb25facd0e137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:01.065537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.066702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.070704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 991/2006] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:00 2022] DELETE /identity/v3/projects/745706ce37a542d8b36eb25facd0e137 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:01.082774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] MFA Rules not processed for user `8eed7ed531f24e60b0ef1e106980f79f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:01.083631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:01.084009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:01.085258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:01.154059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:01.254360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871593-ed05-4b0c-be5e-f75ee335ca19 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:01.274731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1016/2007] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:01.288090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:01.289574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:01.343151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:01.378945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:01.382957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:01.383488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:01.388562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] PATH_INFO: `/v3/users/4b57e9f77837452384148b23283c3e3e` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:01.390708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b57e9f77837452384148b23283c3e3e)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:01.394142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:01.421007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0dad6-92ae-47c4-b919-bac114f086c2 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:01.426400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:01.428485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:01.429598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:01.430269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:01.446056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:01.448341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:01.474187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1017/2008] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:01.493788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b57e9f77837452384148b23283c3e3e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.512862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:01.515277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:01.537507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b57e9f77837452384148b23283c3e3e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.539565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b57e9f77837452384148b23283c3e3e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.541037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b57e9f77837452384148b23283c3e3e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.558775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f893f9-9db3-4fc0-8585-991b2aba41dc service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:01.562782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9217a9f2-85e2-434a-8578-526ce96f3a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b57e9f77837452384148b23283c3e3e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.572495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:01.573768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:01.574211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:01.574406 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] PATH_INFO: `/v3/users/8eed7ed531f24e60b0ef1e106980f79f` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:01.575717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eed7ed531f24e60b0ef1e106980f79f)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:01.578018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:01.604078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 992/2009] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:01 2022] DELETE /identity/v3/users/4b57e9f77837452384148b23283c3e3e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:01.667282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eed7ed531f24e60b0ef1e106980f79f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.698658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eed7ed531f24e60b0ef1e106980f79f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.699465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eed7ed531f24e60b0ef1e106980f79f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.700565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eed7ed531f24e60b0ef1e106980f79f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.711213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eed7ed531f24e60b0ef1e106980f79f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:01.730919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1018/2010] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:01 2022] DELETE /identity/v3/users/8eed7ed531f24e60b0ef1e106980f79f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:01.736299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:01.736598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:01.736885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:01.785994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:01.788272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:01.908096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:01.939302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 993/2011] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:01.983860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:01.990107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:02.085698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee07174-c812-464e-8805-6b7e2a8cc31d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:02.098208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38d7ca-0689-4b14-88de-43455d7c09b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:02.099034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38d7ca-0689-4b14-88de-43455d7c09b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:02.099333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38d7ca-0689-4b14-88de-43455d7c09b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:02.099615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38d7ca-0689-4b14-88de-43455d7c09b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:02.118084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38d7ca-0689-4b14-88de-43455d7c09b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:02.123639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38d7ca-0689-4b14-88de-43455d7c09b4 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:02.136034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1019/2012] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:02.598970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:02.601241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:02.623534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5f5ab-9097-420d-a4a0-e411c77d5611 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:02.650622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:02.651661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:02.651945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:02.652223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] PATH_INFO: `/v3/projects/58d33495cdad426395cfb88ba3fcfb1d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:02.654332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d33495cdad426395cfb88ba3fcfb1d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:02.656271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:02.733347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d33495cdad426395cfb88ba3fcfb1d', 'request_id': 'req-c21d4829-a7b2-4e31-8edb-67ca166e50b0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:02.748672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d33495cdad426395cfb88ba3fcfb1d', 'request_id': 'req-c21d4829-a7b2-4e31-8edb-67ca166e50b0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:02.759860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d33495cdad426395cfb88ba3fcfb1d', 'request_id': 'req-c21d4829-a7b2-4e31-8edb-67ca166e50b0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:02.791277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] The token cache is being invalidate because project 58d33495cdad426395cfb88ba3fcfb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:02.791954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:02.792848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c21d4829-a7b2-4e31-8edb-67ca166e50b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:02.810633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 994/2013] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:02 2022] DELETE /identity/v3/projects/58d33495cdad426395cfb88ba3fcfb1d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:02.811839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a862-7180-41bd-af7f-feea4ad4fe88 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:02.812762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a862-7180-41bd-af7f-feea4ad4fe88 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:02.819051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60a862-7180-41bd-af7f-feea4ad4fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:02.864215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2b60a862-7180-41bd-af7f-feea4ad4fe88 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:02.866331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2b60a862-7180-41bd-af7f-feea4ad4fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:02.950840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:03.033138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1020/2014] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:03.038830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87875-d8ac-4441-ae24-d5610a1ff2c9 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.039611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87875-d8ac-4441-ae24-d5610a1ff2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.043262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd87875-d8ac-4441-ae24-d5610a1ff2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.092410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3bd87875-d8ac-4441-ae24-d5610a1ff2c9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:03.100303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3bd87875-d8ac-4441-ae24-d5610a1ff2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:03.132792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 995/2015] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:03.137144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a862-7180-41bd-af7f-feea4ad4fe88 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:03.161300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60a862-7180-41bd-af7f-feea4ad4fe88 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:03.167699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:03.168997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.169448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.170430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.171605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:03.171918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:03.173813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:03.209697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1021/2016] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:03.215085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd87875-d8ac-4441-ae24-d5610a1ff2c9 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:03.225592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd87875-d8ac-4441-ae24-d5610a1ff2c9 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:03.244609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:03.247724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.247724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.247724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.252105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:03.255027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:03.324296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 996/2017] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:03 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:03.328472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:03.346526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153af4-126f-4c28-abb9-d6e863a93e55 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:03.460445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:03.461608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.461952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.462236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.463058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:03.466573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:03.521456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1022/2018] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:03 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:03.526216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:03.556207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b435f-6de1-4355-8146-97e7e95bd75d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:03.572172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:03.572172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.572562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.572799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.575804 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:03.578417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:03.594770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 997/2019] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:03.596389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:03.629694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc0bb3-e6b2-494b-8c8e-e11df617bbab admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:03.638601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743b775-51d9-4334-99df-07e270a71eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:03.639410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b775-51d9-4334-99df-07e270a71eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.639700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b775-51d9-4334-99df-07e270a71eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.639980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743b775-51d9-4334-99df-07e270a71eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.640729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b775-51d9-4334-99df-07e270a71eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:03.643035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743b775-51d9-4334-99df-07e270a71eb4 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:03.659520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1023/2020] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:03.661249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:03.686813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ab8f-a86a-4665-89b8-3a72f4c2fc70 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:03.706218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:03.707171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.707518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.707800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] PATH_INFO: `/v3/projects/6043841f0f8040788cfef3151e924bcd/users/efb1d64a4e5c44f7ab397b0bcdfdfc0d/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.729271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6043841f0f8040788cfef3151e924bcd, user_id=efb1d64a4e5c44f7ab397b0bcdfdfc0d, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:03.734736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:03.773376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 998/2021] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:03 2022] PUT /identity/v3/projects/6043841f0f8040788cfef3151e924bcd/users/efb1d64a4e5c44f7ab397b0bcdfdfc0d/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:03.780803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:03.781446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:03.781731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:03.818330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] MFA Rules not processed for user `efb1d64a4e5c44f7ab397b0bcdfdfc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:03.820043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:03.978117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1024/2022] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:03.979835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.121808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a3440-856a-4bc3-8622-7684d1f8331f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.138030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.138949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.140134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.140485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.141186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:04.146961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:04.148809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.151502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:04.221083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e28756-3ba5-456d-89f0-5cebe0681bfb None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.239342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:04.248321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.249504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.250143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.258651 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 999/2023] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:03 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:04.265547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.270524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] PATH_INFO: `/v3/projects/1515d95a5c1843ef909db1d059da09e1` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.277920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1515d95a5c1843ef909db1d059da09e1)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:04.285121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:04.378115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:04.441488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1515d95a5c1843ef909db1d059da09e1', 'request_id': 'req-4fc20e31-01dc-43f3-ba55-5a9588414eb2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:04.447661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750cdc2-d4ee-4687-ba11-33c4940b5054 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.462845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1515d95a5c1843ef909db1d059da09e1', 'request_id': 'req-4fc20e31-01dc-43f3-ba55-5a9588414eb2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:04.508091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1515d95a5c1843ef909db1d059da09e1', 'request_id': 'req-4fc20e31-01dc-43f3-ba55-5a9588414eb2'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:04.523868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] The token cache is being invalidate because project 1515d95a5c1843ef909db1d059da09e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:04.524736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:04.525435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4fc20e31-01dc-43f3-ba55-5a9588414eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:04.527582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1025/2024] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:04 2022] DELETE /identity/v3/projects/1515d95a5c1843ef909db1d059da09e1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:04.532785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4152d8-3804-4fbf-bdd6-a36aa95d3245 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.533104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4152d8-3804-4fbf-bdd6-a36aa95d3245 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.542911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4152d8-3804-4fbf-bdd6-a36aa95d3245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.604493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4f4152d8-3804-4fbf-bdd6-a36aa95d3245 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:04.605970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4f4152d8-3804-4fbf-bdd6-a36aa95d3245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:04.648816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.650162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.650496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.650965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.652524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:04.654680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:04.699362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1000/2025] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:04 2022] POST /identity/v3/users => generated 292 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:04.703916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.709871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:04.730286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1026/2026] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:04.740332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc910a-60b0-4384-9baf-95e507bf95a9 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.740981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc910a-60b0-4384-9baf-95e507bf95a9 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.741612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc910a-60b0-4384-9baf-95e507bf95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.751564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd965-20b5-48c8-ae1f-9885df1971f2 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.768888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.769312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-eddc910a-60b0-4384-9baf-95e507bf95a9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:04.769658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.770164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.770614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.771975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-eddc910a-60b0-4384-9baf-95e507bf95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:04.772352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:04.776199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:04.787720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1027/2027] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:04.792693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc910a-60b0-4384-9baf-95e507bf95a9 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.814139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc910a-60b0-4384-9baf-95e507bf95a9 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.819915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.821912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.822366 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.823015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.824212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1001/2028] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:04.828620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:04.829337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:04.829538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.832092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:04.844663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840d8e0-3181-4f8a-b273-aad6574d71d1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.854484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1028/2029] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:04.855687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.861187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.862596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.864175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.865232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.871820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:04.878136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:04.896533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e045-3303-498d-8732-11e546bd99be admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.911021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.911890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.912687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.912687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.913467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:04.917387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:04.928538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1002/2030] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:04.935785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:04.970315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed9109-7142-4839-9d8e-49e9d13e3f13 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:04.995233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40c373-84c9-4bd5-8e92-b28593a60c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:04.996186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40c373-84c9-4bd5-8e92-b28593a60c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:04.996464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40c373-84c9-4bd5-8e92-b28593a60c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:04.996743 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40c373-84c9-4bd5-8e92-b28593a60c62 admin admin] PATH_INFO: `/v3/projects/c893c3c129ed462ea4a15fe56c023948/users/ede0b8c93b5d47289fe0960ff6c8391c/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:04.999679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1029/2031] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:04 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:05.003973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:05.052999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40c373-84c9-4bd5-8e92-b28593a60c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c893c3c129ed462ea4a15fe56c023948, user_id=ede0b8c93b5d47289fe0960ff6c8391c, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:05.056795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40c373-84c9-4bd5-8e92-b28593a60c62 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:05.099342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1003/2032] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:04 2022] PUT /identity/v3/projects/c893c3c129ed462ea4a15fe56c023948/users/ede0b8c93b5d47289fe0960ff6c8391c/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:05.112845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba9fd-a6f2-4e49-a40c-6957eb4ab48a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:05.113174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765843-15c1-4fdf-90f2-4b8f755b8478 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.113555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765843-15c1-4fdf-90f2-4b8f755b8478 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.113818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765843-15c1-4fdf-90f2-4b8f755b8478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.150294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:05.193134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-eb765843-15c1-4fdf-90f2-4b8f755b8478 None None] MFA Rules not processed for user `ede0b8c93b5d47289fe0960ff6c8391c`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:05.207470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-eb765843-15c1-4fdf-90f2-4b8f755b8478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:05.261694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:05.262396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.262707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.262983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.263704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:05.265708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:05.318111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1030/2033] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:05 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:05.324678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:05.325390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:05.344712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6257d-45c3-4e8d-914d-0c8e6891a0f9 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:05.350675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:05.351416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.351685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.352661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.352787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:05.354386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:05.371988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1031/2034] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:05.373025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:05.391805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1004/2035] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:05.395830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb765843-15c1-4fdf-90f2-4b8f755b8478 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:05.397577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077751b3-c143-4a1c-ac80-b856dff493c9 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:05.411386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb765843-15c1-4fdf-90f2-4b8f755b8478 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:05.411836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:05.412636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.412921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.413251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.414131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:05.417063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:05.419508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:05.421581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.422124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.422619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.423904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:05.427241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:05.469467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1032/2036] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:05.475305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:05.485197 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1005/2037] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:05 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:05.486953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:05.492728 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd436bb-b0eb-4afd-8308-3adb9084f929 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:05.640806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcee04-e4be-44ce-a357-7017cf3c5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:05.642396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcee04-e4be-44ce-a357-7017cf3c5af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.643124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcee04-e4be-44ce-a357-7017cf3c5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.643670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcee04-e4be-44ce-a357-7017cf3c5af5 admin admin] PATH_INFO: `/v3/projects/7a1214d68d944c2980887bcef3335c16/users/e062a6c5e9a94e10ac03c041e337a2c3/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.686255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcee04-e4be-44ce-a357-7017cf3c5af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1214d68d944c2980887bcef3335c16, user_id=e062a6c5e9a94e10ac03c041e337a2c3, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:05.692918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcee04-e4be-44ce-a357-7017cf3c5af5 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:05.709524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f340a-8299-4c87-834a-f69c72951439 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:05.730799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:05.730799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.730799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.730799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.735305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:05.743873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:05.755120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1033/2038] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:05 2022] PUT /identity/v3/projects/7a1214d68d944c2980887bcef3335c16/users/e062a6c5e9a94e10ac03c041e337a2c3/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:05.762823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:05.763623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:05.764329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:05.813491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:05.818732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:05.820523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1006/2039] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:05 2022] POST /identity/v3/users => generated 299 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:05.822404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:05.876968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e346-4edd-4eab-9f3f-f2a260b050f7 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:05.992109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1034/2040] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:06.010853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:06.016288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:06.062427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:06.111242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:06.111945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:06.112224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:06.112495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:06.113532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:06.115567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:06.144191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1007/2041] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:06.145854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:06.163661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ed324-a43e-47b0-a939-675e4e39b139 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:06.164471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23d0de-8b63-4352-94fd-571405370b39 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:06.172077 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:06.174156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:06.175018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:06.175668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:06.176107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:06.178069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:06.179203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:06.182049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] PATH_INFO: `/v3/projects/2accbd7d0043467bab9ce008fca851d4/users/627d1f063b0e4c519f75e48b285ecb3a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:06.205134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:06.206991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:06.221486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2accbd7d0043467bab9ce008fca851d4, user_id=627d1f063b0e4c519f75e48b285ecb3a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:06.226331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:06.232254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1035/2042] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:06.253557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1008/2043] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:06 2022] PUT /identity/v3/projects/2accbd7d0043467bab9ce008fca851d4/users/627d1f063b0e4c519f75e48b285ecb3a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:06.258092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:06.274699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a76094-2cc7-4aea-9274-b27767f41b00 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:06.411816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960f221-95fc-4846-990b-6f19fa1f422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:06.412901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f221-95fc-4846-990b-6f19fa1f422c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:06.419495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f221-95fc-4846-990b-6f19fa1f422c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:06.419987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f221-95fc-4846-990b-6f19fa1f422c admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:06.421345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960f221-95fc-4846-990b-6f19fa1f422c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:06.424741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960f221-95fc-4846-990b-6f19fa1f422c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:06.459189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1036/2044] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:06.461609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:06.476271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae64c6-eb0e-4707-95d7-527b0f3bfa4e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:06.485433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:06.486535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:06.486910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:06.487267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] PATH_INFO: `/v3/projects/2accbd7d0043467bab9ce008fca851d4/users/627d1f063b0e4c519f75e48b285ecb3a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:06.491516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2accbd7d0043467bab9ce008fca851d4, user_id=627d1f063b0e4c519f75e48b285ecb3a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:06.497386 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:06.512506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1009/2045] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:06 2022] PUT /identity/v3/projects/2accbd7d0043467bab9ce008fca851d4/users/627d1f063b0e4c519f75e48b285ecb3a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:06.523484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb503a-8741-4139-9b25-be85931e72c9 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:06.524213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb503a-8741-4139-9b25-be85931e72c9 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:06.524759 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb503a-8741-4139-9b25-be85931e72c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:06.565388 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e3fb503a-8741-4139-9b25-be85931e72c9 None None] MFA Rules not processed for user `627d1f063b0e4c519f75e48b285ecb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:06.567118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e3fb503a-8741-4139-9b25-be85931e72c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:06.704227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1037/2046] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:06.715977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:06.718008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:06.733647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:06.800719 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a065c9-eb0d-49fd-ac36-6922a988ea2c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:06.806843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daa0a0-64ea-440c-bbd4-5af0eb77e638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:06.807853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa0a0-64ea-440c-bbd4-5af0eb77e638 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:06.808695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa0a0-64ea-440c-bbd4-5af0eb77e638 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:06.809158 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daa0a0-64ea-440c-bbd4-5af0eb77e638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:06.834064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa0a0-64ea-440c-bbd4-5af0eb77e638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:06.835229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daa0a0-64ea-440c-bbd4-5af0eb77e638 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:06.869251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1010/2047] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:07.794913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb503a-8741-4139-9b25-be85931e72c9 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:07.811951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb503a-8741-4139-9b25-be85931e72c9 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:07.829334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:07.829972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:07.830272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:07.830559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:07.842989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:07.938897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:07.988528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c736c90-9dda-42da-9a87-81f9823d8af7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:07.989880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c736c90-9dda-42da-9a87-81f9823d8af7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:07.990320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c736c90-9dda-42da-9a87-81f9823d8af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:08.021461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:08.022991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:08.054624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8c736c90-9dda-42da-9a87-81f9823d8af7 None None] MFA Rules not processed for user `e062a6c5e9a94e10ac03c041e337a2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:08.056317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8c736c90-9dda-42da-9a87-81f9823d8af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:08.059526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1038/2048] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:08.325149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1011/2049] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:08.333336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:08.335800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:08.355626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d806f-6fbf-46af-8f91-94a5d70c9417 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:08.380201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:08.381135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:08.381578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:08.381999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:08.414148 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:08.422013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:08.448272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31e101-4700-4be9-8966-8f519c2e2642 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:08.448574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31e101-4700-4be9-8966-8f519c2e2642 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:08.448855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31e101-4700-4be9-8966-8f519c2e2642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:08.468997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1039/2050] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:08.545953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-dc31e101-4700-4be9-8966-8f519c2e2642 None None] MFA Rules not processed for user `87836624f7254574b5404fef6cf55d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:08.547292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dc31e101-4700-4be9-8966-8f519c2e2642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:08.712032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1012/2051] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:08.716574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:08.718082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:08.887950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e65de-5b5f-4521-b2bc-f0f802b138f4 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:08.900694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:08.901753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:08.902232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:08.902753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:08.903739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:08.906578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:08.956928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1040/2052] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:08 2022] POST /identity/v3/projects => generated 371 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:08.961122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31e101-4700-4be9-8966-8f519c2e2642 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:09.000928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31e101-4700-4be9-8966-8f519c2e2642 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:09.084204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:09.147100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:09.147912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:09.148300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:09.150255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:09.151354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:09.153788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:09.202604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1013/2053] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:08 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:09.206593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:09.229506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8cf75-7151-4bbc-96ba-8781dd7a3bf3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:09.236279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:09.237094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:09.237511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:09.238002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:09.239002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:09.240805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:09.263196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1041/2054] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:09.264233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:09.277898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3c6d6-e546-4aae-b5c5-092aae1fde35 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:09.286409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:09.288318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:09.288794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:09.289239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] PATH_INFO: `/v3/projects/7b5415d0216f4b5ebdd77ba78c162297/users/5a99a886ea9c4f1ba2cebba65f3c8e51/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:09.314235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5415d0216f4b5ebdd77ba78c162297, user_id=5a99a886ea9c4f1ba2cebba65f3c8e51, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:09.317820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:09.341505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1014/2055] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:09 2022] PUT /identity/v3/projects/7b5415d0216f4b5ebdd77ba78c162297/users/5a99a886ea9c4f1ba2cebba65f3c8e51/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:09.345618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:09.364798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e15f9e-beab-467b-bcbe-947c98306458 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:09.440594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71abf51-21b5-40c8-ac9b-45de2294fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:09.441444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71abf51-21b5-40c8-ac9b-45de2294fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:09.441734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71abf51-21b5-40c8-ac9b-45de2294fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:09.442013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71abf51-21b5-40c8-ac9b-45de2294fa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:09.442810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71abf51-21b5-40c8-ac9b-45de2294fa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:09.444474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71abf51-21b5-40c8-ac9b-45de2294fa9a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:09.456127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1042/2056] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:09.462954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:09.474340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3aa8-1af5-477e-a648-8ee93b69c854 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:09.482804 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:09.484273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:09.484752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:09.485176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] PATH_INFO: `/v3/projects/7b5415d0216f4b5ebdd77ba78c162297/users/5a99a886ea9c4f1ba2cebba65f3c8e51/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:09.488536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5415d0216f4b5ebdd77ba78c162297, user_id=5a99a886ea9c4f1ba2cebba65f3c8e51, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:09.493921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:09.507119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1015/2057] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:09 2022] PUT /identity/v3/projects/7b5415d0216f4b5ebdd77ba78c162297/users/5a99a886ea9c4f1ba2cebba65f3c8e51/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:10.281472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5728-6ba3-43f6-944b-d78d73d5043c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:10.282104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5728-6ba3-43f6-944b-d78d73d5043c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:10.282104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5728-6ba3-43f6-944b-d78d73d5043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:10.328969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-019e5728-6ba3-43f6-944b-d78d73d5043c None None] MFA Rules not processed for user `e062a6c5e9a94e10ac03c041e337a2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:10.330810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-019e5728-6ba3-43f6-944b-d78d73d5043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:10.419425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:10.480967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1043/2058] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:13.289046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:13.454356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05578d-e7c9-4580-b165-1a6d87c1d04d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:13.460321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:13.462034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:13.462572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:13.463973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:13.580577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:13.582371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:13.620329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1016/2059] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:17.323738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:17.324477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:17.324477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:17.422732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] MFA Rules not processed for user `5a99a886ea9c4f1ba2cebba65f3c8e51`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:17.424212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:17.569931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1044/2060] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:17.570321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:17.584412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:17.585854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:17.654267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:17.708156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4a93-913e-4eab-aa46-417826ffc0ef service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:17.715556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:17.716501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd84b93-63a6-42a5-abf6-be363cd139d5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:17.716721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:17.717199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:17.717550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] PATH_INFO: `/v3/users/efb1d64a4e5c44f7ab397b0bcdfdfc0d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:17.718990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb1d64a4e5c44f7ab397b0bcdfdfc0d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:17.721485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:17.722572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9745-d4e8-4bbe-a77c-df43cdb9131d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:17.723278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9745-d4e8-4bbe-a77c-df43cdb9131d service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:17.723650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9745-d4e8-4bbe-a77c-df43cdb9131d service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:17.723839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9745-d4e8-4bbe-a77c-df43cdb9131d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:17.798911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb1d64a4e5c44f7ab397b0bcdfdfc0d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:17.820516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb9745-d4e8-4bbe-a77c-df43cdb9131d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:17.823394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb9745-d4e8-4bbe-a77c-df43cdb9131d service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:17.833453 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb1d64a4e5c44f7ab397b0bcdfdfc0d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:17.834520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb1d64a4e5c44f7ab397b0bcdfdfc0d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:17.836081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb1d64a4e5c44f7ab397b0bcdfdfc0d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:17.838777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:17.848454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb1d64a4e5c44f7ab397b0bcdfdfc0d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:17.849988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1045/2061] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:17.871143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1017/2062] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:17 2022] DELETE /identity/v3/users/efb1d64a4e5c44f7ab397b0bcdfdfc0d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:17.876288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:17.876677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:17.877160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:17.899005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:17.900676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:17.997201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1046/2063] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:18.009930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:18.011667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:18.125417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f2a2-8a1b-40a9-a3ab-467531391ecc admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:18.133570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:18.138520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:18.138986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:18.139269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:18.154071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:18.155675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:18.180833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1018/2064] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:18.599232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:18.603948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:18.655043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c47084-75f4-4ae2-80ea-857602e7bff6 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:18.673310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:18.675496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:18.678569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:18.679484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] PATH_INFO: `/v3/projects/6043841f0f8040788cfef3151e924bcd` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:18.682250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6043841f0f8040788cfef3151e924bcd)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:18.687059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:18.800101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6043841f0f8040788cfef3151e924bcd', 'request_id': 'req-3471a734-1bdd-4e17-a8b9-613e341fa216'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:18.816714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6043841f0f8040788cfef3151e924bcd', 'request_id': 'req-3471a734-1bdd-4e17-a8b9-613e341fa216'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:18.836019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6043841f0f8040788cfef3151e924bcd', 'request_id': 'req-3471a734-1bdd-4e17-a8b9-613e341fa216'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:18.870665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] The token cache is being invalidate because project 6043841f0f8040788cfef3151e924bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:18.871037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:18.871970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3471a734-1bdd-4e17-a8b9-613e341fa216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:18.874752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1047/2065] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:18 2022] DELETE /identity/v3/projects/6043841f0f8040788cfef3151e924bcd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:18.880204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:18.898165 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e5e9-e411-4da9-950b-a3062aca1bc2 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:19.024625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:19.053667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:19.054765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:19.060756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:19.061148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] PATH_INFO: `/v3/users/ede0b8c93b5d47289fe0960ff6c8391c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:19.068673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede0b8c93b5d47289fe0960ff6c8391c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:19.071266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:19.235779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede0b8c93b5d47289fe0960ff6c8391c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:19.262292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede0b8c93b5d47289fe0960ff6c8391c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:19.263295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede0b8c93b5d47289fe0960ff6c8391c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:19.264526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede0b8c93b5d47289fe0960ff6c8391c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:19.299493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede0b8c93b5d47289fe0960ff6c8391c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:19.351907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1019/2066] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:18 2022] DELETE /identity/v3/users/ede0b8c93b5d47289fe0960ff6c8391c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:19.935398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a77e44-2a9c-4349-8def-62703a9e1871 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:19.935930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a77e44-2a9c-4349-8def-62703a9e1871 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:19.936009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a77e44-2a9c-4349-8def-62703a9e1871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:19.967840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-50a77e44-2a9c-4349-8def-62703a9e1871 None None] MFA Rules not processed for user `87836624f7254574b5404fef6cf55d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:19.969204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-50a77e44-2a9c-4349-8def-62703a9e1871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:20.037667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:20.040406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:20.130988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1048/2067] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:20.212339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8894e-7ae6-420f-b203-b45149da40d2 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:20.234377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:20.235345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:20.235640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:20.235922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] PATH_INFO: `/v3/projects/c893c3c129ed462ea4a15fe56c023948` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:20.240732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c893c3c129ed462ea4a15fe56c023948)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:20.251509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:20.416220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c893c3c129ed462ea4a15fe56c023948', 'request_id': 'req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.443806 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c893c3c129ed462ea4a15fe56c023948', 'request_id': 'req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.468148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c893c3c129ed462ea4a15fe56c023948', 'request_id': 'req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.487994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] The token cache is being invalidate because project c893c3c129ed462ea4a15fe56c023948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:20.488332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.489150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.490986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1020/2068] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:20 2022] DELETE /identity/v3/projects/c893c3c129ed462ea4a15fe56c023948 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:20.496224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a77e44-2a9c-4349-8def-62703a9e1871 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:20.513011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a77e44-2a9c-4349-8def-62703a9e1871 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:20.564787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:20.642847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:20.644621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:20.645267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:20.646136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] PATH_INFO: `/v3/users/627d1f063b0e4c519f75e48b285ecb3a` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:20.651375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=627d1f063b0e4c519f75e48b285ecb3a)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:20.652845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:20.793182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627d1f063b0e4c519f75e48b285ecb3a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.832122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627d1f063b0e4c519f75e48b285ecb3a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.835138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627d1f063b0e4c519f75e48b285ecb3a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.836126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627d1f063b0e4c519f75e48b285ecb3a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.846939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7231b0a8-64c3-41bf-8005-20e5bb9ee12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627d1f063b0e4c519f75e48b285ecb3a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:20.900222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1049/2069] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:20 2022] DELETE /identity/v3/users/627d1f063b0e4c519f75e48b285ecb3a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:21.668183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:21.672443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:21.713497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fdaba-a9f3-4c0b-b358-2ecea7b57ff4 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:21.724670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:21.952373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:21.953287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:21.953626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:21.953910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] PATH_INFO: `/v3/projects/2accbd7d0043467bab9ce008fca851d4` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:21.955307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2accbd7d0043467bab9ce008fca851d4)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:21.957502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:22.059054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2accbd7d0043467bab9ce008fca851d4', 'request_id': 'req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:22.072355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2accbd7d0043467bab9ce008fca851d4', 'request_id': 'req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:22.101945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2accbd7d0043467bab9ce008fca851d4', 'request_id': 'req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:22.118406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] The token cache is being invalidate because project 2accbd7d0043467bab9ce008fca851d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:22.118922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:22.120044 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-284c6411-22c0-4cb8-a2fc-6c0d0399dac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:22.126456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1021/2070] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:21 2022] DELETE /identity/v3/projects/2accbd7d0043467bab9ce008fca851d4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:22.129177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471b23f-8b31-409b-812e-393cb237cf1e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.129786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471b23f-8b31-409b-812e-393cb237cf1e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.130345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471b23f-8b31-409b-812e-393cb237cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:22.161542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-f471b23f-8b31-409b-812e-393cb237cf1e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:22.164997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f471b23f-8b31-409b-812e-393cb237cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:22.379213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1050/2071] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:22.390429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01657-2fe2-449c-bb1c-f04fdf5230c4 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.391054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01657-2fe2-449c-bb1c-f04fdf5230c4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.391549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c01657-2fe2-449c-bb1c-f04fdf5230c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:22.436236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-71c01657-2fe2-449c-bb1c-f04fdf5230c4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:22.437672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-71c01657-2fe2-449c-bb1c-f04fdf5230c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:22.454751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1022/2072] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:22.457773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471b23f-8b31-409b-812e-393cb237cf1e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:22.474622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471b23f-8b31-409b-812e-393cb237cf1e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:22.486065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:22.486802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.488891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.488891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:22.489667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:22.495642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:22.495642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:22.516315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1051/2073] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:22.520647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01657-2fe2-449c-bb1c-f04fdf5230c4 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:22.540265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c01657-2fe2-449c-bb1c-f04fdf5230c4 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:22.551347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:22.552057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.552367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.553193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:22.554005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:22.556528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:22.613268 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1023/2074] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:22 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:22.615884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:22.637228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5b8fd-a6a2-4284-b3d1-735996e36e59 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:22.714289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:22.784710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:22.785754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.786255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.786808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:22.787697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:22.793928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:22.834629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1052/2075] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:22 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:22.836598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:22.863608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44d995-1a56-4947-939e-5f135f4dae01 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:22.876633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:22.878421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.878819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.879173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:22.880020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:22.881931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:22.909222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1024/2076] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:22.914836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:22.934231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe72c-7e2f-4106-b5c6-8421a5695764 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:22.941769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c46cc1-ebcd-4547-bc6f-915c30d3c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:22.942470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46cc1-ebcd-4547-bc6f-915c30d3c44c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.942784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46cc1-ebcd-4547-bc6f-915c30d3c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.943063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c46cc1-ebcd-4547-bc6f-915c30d3c44c admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:22.946730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c46cc1-ebcd-4547-bc6f-915c30d3c44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:22.946730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c46cc1-ebcd-4547-bc6f-915c30d3c44c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:22.960160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1053/2077] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:22.964793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:22.978382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11a3e-a050-400a-b705-a31d696bd969 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:22.985041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:22.986085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:22.986376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:22.986650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] PATH_INFO: `/v3/projects/af27b41717524d7f826ed8499acbc7d3/users/a0d0ffc53bd74add887c9557d1d5bca3/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.007260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af27b41717524d7f826ed8499acbc7d3, user_id=a0d0ffc53bd74add887c9557d1d5bca3, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:23.013117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:23.038556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1025/2078] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:22 2022] PUT /identity/v3/projects/af27b41717524d7f826ed8499acbc7d3/users/a0d0ffc53bd74add887c9557d1d5bca3/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:23.051562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe323d-a760-45eb-aa07-bf424cd8e63c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.052477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe323d-a760-45eb-aa07-bf424cd8e63c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.052938 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe323d-a760-45eb-aa07-bf424cd8e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.109334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-adbe323d-a760-45eb-aa07-bf424cd8e63c None None] MFA Rules not processed for user `a0d0ffc53bd74add887c9557d1d5bca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:23.110663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-adbe323d-a760-45eb-aa07-bf424cd8e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:23.250981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1054/2079] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:23.255442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:23.329550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b9db-39b3-4353-81fe-047265403fa0 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.329914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b9db-39b3-4353-81fe-047265403fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.330204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792b9db-39b3-4353-81fe-047265403fa0 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.331723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1055/2080] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:23:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:23:23.337417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:23.349317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.349607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.349886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.381348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:23.382713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:23.394008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5c215-67d3-4732-b919-5e118f71123e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:23.400092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:23.401188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.401547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.401893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.403347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:23.406965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:23.446288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1026/2081] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:23 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:23.451003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:23.514204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1056/2082] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:23.515835 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:23.517950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:23.538159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21dc2-02e1-41ce-a02a-d8f2717769bf None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:23.597227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbe818-6f11-4fc8-9f8a-d6d5756d0fea admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:23.604549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:23.605242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.605521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.605797 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.606499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:23.611928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:23.615081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:23.650907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1027/2083] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:23 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:23.651769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:23.653440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:23.656616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:23.657517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.657801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.658078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] PATH_INFO: `/v3/users/62374595979246448444c17ee227a420` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.659474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62374595979246448444c17ee227a420)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:23.661583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:23.732802 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62374595979246448444c17ee227a420'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:23.747694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62374595979246448444c17ee227a420'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:23.748417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62374595979246448444c17ee227a420'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:23.749045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62374595979246448444c17ee227a420'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:23.756289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62374595979246448444c17ee227a420'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:23.758077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7ab74-6b12-4ebc-8f91-3d6761bec0e8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:23.764003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:23.764832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.765251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.765542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.767549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:23.773549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1057/2084] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:23 2022] DELETE /identity/v3/users/62374595979246448444c17ee227a420 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:23.774783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:23.776514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:23.781700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:23.783432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:23.795622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1028/2085] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:23.856379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14af37c-8d80-448c-a0cc-fd4d21360f3d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:23.861816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:23.862510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.862833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.863114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.863875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:23.865571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:23.877498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1058/2086] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:23.881528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:23.892933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31289826-fe1d-4dc1-b2f8-73070c94f764 service placement] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:23.897704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:23.898710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:23.899043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:23.899326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] PATH_INFO: `/v3/projects/510ea1a949734260afdd88499cfd4015/users/0b47d0e65e08424faf6304374fb249db/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:23.920820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510ea1a949734260afdd88499cfd4015, user_id=0b47d0e65e08424faf6304374fb249db, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:23.923866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:23.943172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1029/2087] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:23 2022] PUT /identity/v3/projects/510ea1a949734260afdd88499cfd4015/users/0b47d0e65e08424faf6304374fb249db/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:23.946983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:23.963736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfcfc5-f898-4fc0-bb5d-c6afb65b2d69 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.005276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.007109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.037090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:24.038973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:24.052613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.054970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.055431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.056012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.058463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.063765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.078882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1059/2088] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:24.079831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.093990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12809ed7-7ab3-4ecc-a6a0-8f8636a461e7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.099809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633b764-b285-4216-aca8-483b678ddbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.101068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b764-b285-4216-aca8-483b678ddbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.101392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b764-b285-4216-aca8-483b678ddbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.102442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b764-b285-4216-aca8-483b678ddbd3 admin admin] PATH_INFO: `/v3/projects/510ea1a949734260afdd88499cfd4015/users/0b47d0e65e08424faf6304374fb249db/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.105655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633b764-b285-4216-aca8-483b678ddbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510ea1a949734260afdd88499cfd4015, user_id=0b47d0e65e08424faf6304374fb249db, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.108745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633b764-b285-4216-aca8-483b678ddbd3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.121093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de764-354e-4b4e-bb5d-db7dfdc3feb3 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.121355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1060/2089] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:24 2022] PUT /identity/v3/projects/510ea1a949734260afdd88499cfd4015/users/0b47d0e65e08424faf6304374fb249db/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:24.131806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.132185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.132467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.162522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] MFA Rules not processed for user `0b47d0e65e08424faf6304374fb249db`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:24.164755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.187892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.188761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.189039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.189433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] PATH_INFO: `/v3/projects/2cb665dac9894afc81d3f4dedfdbc551` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.190657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb665dac9894afc81d3f4dedfdbc551)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.192775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.250187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1061/2090] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:24.254955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb665dac9894afc81d3f4dedfdbc551', 'request_id': 'req-3b1db26c-583a-4a58-998b-e7a380e49156'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:24.263261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.264457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb665dac9894afc81d3f4dedfdbc551', 'request_id': 'req-3b1db26c-583a-4a58-998b-e7a380e49156'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:24.264995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.272530 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb665dac9894afc81d3f4dedfdbc551', 'request_id': 'req-3b1db26c-583a-4a58-998b-e7a380e49156'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:24.287167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] The token cache is being invalidate because project 2cb665dac9894afc81d3f4dedfdbc551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:24.287440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:24.291016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3b1db26c-583a-4a58-998b-e7a380e49156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:24.294407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1030/2091] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:24 2022] DELETE /identity/v3/projects/2cb665dac9894afc81d3f4dedfdbc551 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:24.299614 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6565a6-c57a-4485-8ba2-4089d0816c68 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.299950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6565a6-c57a-4485-8ba2-4089d0816c68 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.300189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6565a6-c57a-4485-8ba2-4089d0816c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.320033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-9b6565a6-c57a-4485-8ba2-4089d0816c68 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:24.321910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9b6565a6-c57a-4485-8ba2-4089d0816c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.346464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafcc8e-9e4d-4480-b4a4-34d727c82975 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.376198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:24.395402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1031/2092] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:24.409545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bd181-2c21-403a-aab7-cbe3d06f1c0d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.409545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bd181-2c21-403a-aab7-cbe3d06f1c0d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.409545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bd181-2c21-403a-aab7-cbe3d06f1c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.440587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.441282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.441572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.441918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.444394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.450940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d06bd181-2c21-403a-aab7-cbe3d06f1c0d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:24.452257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d06bd181-2c21-403a-aab7-cbe3d06f1c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.460878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1032/2093] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:24.465658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bd181-2c21-403a-aab7-cbe3d06f1c0d None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.476206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bd181-2c21-403a-aab7-cbe3d06f1c0d None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.481166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.481839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.482124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.482402 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.483177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:24.483490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.485141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.494733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:24.500354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1033/2094] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:23:24.504838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.515459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e082e19-061c-43e9-a8d6-4d16597d88fb admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.525115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.525782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.526064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.526329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.527057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.529017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.532655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.534149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.546215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1062/2095] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:24.569621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1034/2096] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:24 2022] POST /identity/v3/projects => generated 361 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:24.574413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.589289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1025b-ee5e-4a61-b90d-14afd1f77bb0 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.607312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.612162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.678804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.679503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.679843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.680121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.681003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.682986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.705304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76be849-06db-4f40-89e0-87a9ff5f356a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.713107 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1063/2097] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:24 2022] POST /identity/v3/users => generated 281 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:24.715444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.717259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08de247-b7c4-4517-9fca-2b3e9f2b62fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.720732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de247-b7c4-4517-9fca-2b3e9f2b62fd service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.721260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de247-b7c4-4517-9fca-2b3e9f2b62fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.722291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de247-b7c4-4517-9fca-2b3e9f2b62fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.724835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c08de247-b7c4-4517-9fca-2b3e9f2b62fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:24.728495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86673f2f-1053-4010-b485-f45e2ac1e63e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.734464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.735306 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.735558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.735832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.737212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.739685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.756481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1064/2098] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:24.757735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.769436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1c0df-3033-4a79-a787-5db243d9d4be admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.777141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.777828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.778114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.778390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.779168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.780791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.803571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1065/2099] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:24.808092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:24.814822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08de247-b7c4-4517-9fca-2b3e9f2b62fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.816652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08de247-b7c4-4517-9fca-2b3e9f2b62fd service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.821941 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c90f3-b318-4c73-a143-c71bee17c7ba admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:24.830621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:24.832021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.832667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.833157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] PATH_INFO: `/v3/projects/ff3cb4edfcbb419cb4c1001873a23350/users/e74ddb968948433da2ba19dac098e04e/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.850363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1035/2100] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:24.860176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3cb4edfcbb419cb4c1001873a23350, user_id=e74ddb968948433da2ba19dac098e04e, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:24.860931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:24.881467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1066/2101] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:24 2022] PUT /identity/v3/projects/ff3cb4edfcbb419cb4c1001873a23350/users/e74ddb968948433da2ba19dac098e04e/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:24.892201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:24.892790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:24.892790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:24.941334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] MFA Rules not processed for user `e74ddb968948433da2ba19dac098e04e`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:24.942993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:25.024239 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:25.042177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1036/2102] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:25.047118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.135035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.139891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:25.166713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abdad1-ed77-4b71-aed1-bf0a58e054c6 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.173680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.174377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.175171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.175482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.176927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.181179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.213551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:25.228666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1067/2103] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:25 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:25.230202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.272707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78655c1-be34-4086-b529-42c62247f5bc None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.346641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81348dc9-0afb-4801-bb6d-7a9872c90c64 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.348851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.349342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.349628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.349899 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] PATH_INFO: `/v3/users/d4070271d5e348beb533687e36b5e408` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.351305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4070271d5e348beb533687e36b5e408)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.353537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.354881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.355644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.356331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.356331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.356915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.358886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.385403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1068/2104] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:25 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:25.386722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.397235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be0f7b-5c52-4a15-a888-e1670e6273a8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.407640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.409093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.409469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.409778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.410593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.412738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.420549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4070271d5e348beb533687e36b5e408'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:25.424424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1069/2105] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:25.428742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.436229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4070271d5e348beb533687e36b5e408'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:25.436999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4070271d5e348beb533687e36b5e408'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:25.437613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4070271d5e348beb533687e36b5e408'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:25.439227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a26-4670-4bea-92c4-149f9495ea56 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.445005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-caa054f5-8c46-4146-ad2d-3990f1655171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4070271d5e348beb533687e36b5e408'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:25.446999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.448261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.448545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.449202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] PATH_INFO: `/v3/projects/4d1a5b33c33e4e909175fa823ec30951/users/94053173eb4c48d09a3344a3193979db/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.466359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1037/2106] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:25 2022] DELETE /identity/v3/users/d4070271d5e348beb533687e36b5e408 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:25.471447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.471742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.472028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.473501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1a5b33c33e4e909175fa823ec30951, user_id=94053173eb4c48d09a3344a3193979db, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.476823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.497186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1070/2107] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:25 2022] PUT /identity/v3/projects/4d1a5b33c33e4e909175fa823ec30951/users/94053173eb4c48d09a3344a3193979db/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:25.501833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.508721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:25.508934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:25.510565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:25.525830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:25.590640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1038/2108] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:25.600304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16ebb4-f592-47e1-a0fb-8951bc1cd7d2 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.600931 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.602646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:25.605767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.606452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.606786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.607052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.607834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.609483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.628305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1071/2109] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:25.629598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.641593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a01cb-8c16-42cb-ae12-318dc1469bef admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.650842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039917-815d-45d7-857a-90a033c00b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.652403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039917-815d-45d7-857a-90a033c00b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.652600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039917-815d-45d7-857a-90a033c00b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.653561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039917-815d-45d7-857a-90a033c00b7f admin admin] PATH_INFO: `/v3/projects/4d1a5b33c33e4e909175fa823ec30951/users/94053173eb4c48d09a3344a3193979db/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.657825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039917-815d-45d7-857a-90a033c00b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1a5b33c33e4e909175fa823ec30951, user_id=94053173eb4c48d09a3344a3193979db, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.661756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039917-815d-45d7-857a-90a033c00b7f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.673746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1072/2110] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:25 2022] PUT /identity/v3/projects/4d1a5b33c33e4e909175fa823ec30951/users/94053173eb4c48d09a3344a3193979db/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:25.684993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.685293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.685576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.695080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5d046-7777-4438-b7c7-a57cfae41913 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.723374 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] MFA Rules not processed for user `94053173eb4c48d09a3344a3193979db`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:25.725711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:25.756815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.757213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:25.757523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.758572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.758775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.825402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1073/2111] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:25.841860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:25.842906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.843250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:25.844441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.858798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1039/2112] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:25.926275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52ccb8-8e29-44c8-b581-b937889872ef None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:25.931385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d753530-fe45-45c5-8803-2305b9ca4b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:25.942058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753530-fe45-45c5-8803-2305b9ca4b96 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:25.942363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753530-fe45-45c5-8803-2305b9ca4b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:25.942627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d753530-fe45-45c5-8803-2305b9ca4b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:25.971840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d753530-fe45-45c5-8803-2305b9ca4b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:25.974343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d753530-fe45-45c5-8803-2305b9ca4b96 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:25.988422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1074/2113] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:26.315717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:26.318727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:26.336399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee04e1-5119-4cfd-9f53-5cb84b4e6cfa service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:26.343022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:26.344600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.345211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.345551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] PATH_INFO: `/v3/projects/7dbebf92933e4bf6a695be05c4e8a96a` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.348472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbebf92933e4bf6a695be05c4e8a96a)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:26.350523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:26.378653 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:26.408541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbebf92933e4bf6a695be05c4e8a96a', 'request_id': 'req-647a7b95-bcee-4180-832d-a315fea380e0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.419756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbebf92933e4bf6a695be05c4e8a96a', 'request_id': 'req-647a7b95-bcee-4180-832d-a315fea380e0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.433412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbebf92933e4bf6a695be05c4e8a96a', 'request_id': 'req-647a7b95-bcee-4180-832d-a315fea380e0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.448421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] The token cache is being invalidate because project 7dbebf92933e4bf6a695be05c4e8a96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:26.448807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.449691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.451916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1040/2114] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:26 2022] DELETE /identity/v3/projects/7dbebf92933e4bf6a695be05c4e8a96a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:26.457080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914c6f-6c68-4301-b29c-2ea7e196de5d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.457596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914c6f-6c68-4301-b29c-2ea7e196de5d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.457888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914c6f-6c68-4301-b29c-2ea7e196de5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.482458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8c914c6f-6c68-4301-b29c-2ea7e196de5d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:26.483914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8c914c6f-6c68-4301-b29c-2ea7e196de5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:26.545486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:26.547007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:26.611105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1075/2115] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:26.618981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f97b5-3058-46da-b4d4-a3635ab4c44f None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.619272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f97b5-3058-46da-b4d4-a3635ab4c44f None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.619556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f97b5-3058-46da-b4d4-a3635ab4c44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.640154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bd7f97b5-3058-46da-b4d4-a3635ab4c44f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:26.641368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bd7f97b5-3058-46da-b4d4-a3635ab4c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:26.650654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1076/2116] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:26.655235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f97b5-3058-46da-b4d4-a3635ab4c44f None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:26.656750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a7b95-bcee-4180-832d-a315fea380e0 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:26.663337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:26.664161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.664444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.664718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] PATH_INFO: `/v3/users/e74ddb968948433da2ba19dac098e04e` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.667497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74ddb968948433da2ba19dac098e04e)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:26.668087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:26.672846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f97b5-3058-46da-b4d4-a3635ab4c44f None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:26.683177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:26.684342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.684691 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.685217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.686056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:26.687250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:26.688981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:26.706363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1077/2117] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:23:26.711634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:26.725980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b808c-2114-4040-b927-98d7e5716457 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:26.728699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74ddb968948433da2ba19dac098e04e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.732494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:26.733247 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.733632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.734018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.734968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:26.737114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:26.749836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74ddb968948433da2ba19dac098e04e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.750573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74ddb968948433da2ba19dac098e04e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.751207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74ddb968948433da2ba19dac098e04e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.760882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a1c5720d-2103-4a6b-bc5d-91b54ff51a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74ddb968948433da2ba19dac098e04e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:26.774736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1078/2118] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:26 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:26.776702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:26.778649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:26.784297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1041/2119] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:26 2022] DELETE /identity/v3/users/e74ddb968948433da2ba19dac098e04e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:26.788609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.788952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.789241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.813770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:26.816109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:26.818018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:26.858522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:26.870410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94a641-c0dc-4453-ab75-c340ec5bba9e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:26.910839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1042/2120] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:26.918333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:26.919850 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:26.954955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:26.956058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:26.956265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:26.956544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:26.957249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:26.968558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:26.997627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1079/2121] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:26 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:27.001620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:27.012493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd980a-5e3c-48b5-828e-01af2c4227d9 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:27.014080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:27.015246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aba3cb-cb34-4474-8df2-7b5072fa764a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:27.015643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.016025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.016404 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.023570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:27.024441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.024727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.025005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.025809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:27.028468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:27.034944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:27.037797 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:27.054402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1080/2122] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:27.055103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1043/2123] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:27.055826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:27.068003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c540c-e89b-43ad-8dd6-359e31b2e106 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:27.082046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521a8b-8443-43f3-811e-711a762602d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:27.084012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521a8b-8443-43f3-811e-711a762602d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.084012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521a8b-8443-43f3-811e-711a762602d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.084012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521a8b-8443-43f3-811e-711a762602d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.086553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521a8b-8443-43f3-811e-711a762602d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:27.086553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521a8b-8443-43f3-811e-711a762602d9 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:27.118948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1081/2124] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:27.120449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:27.157312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc63425-64bc-47d3-8c92-9dc6712c1eeb service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:27.172445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:27.174008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.174674 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.174997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] PATH_INFO: `/v3/projects/d649501a1cfa403bad8d3c61779fdd0e/users/71c948885da849b299c87fef651aa4a7/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.204889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d649501a1cfa403bad8d3c61779fdd0e, user_id=71c948885da849b299c87fef651aa4a7, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:27.215560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:27.242945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1044/2125] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:27 2022] PUT /identity/v3/projects/d649501a1cfa403bad8d3c61779fdd0e/users/71c948885da849b299c87fef651aa4a7/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:27.258658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4fe4-0269-431d-bb9f-4fbc9c6cbac2 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.259072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4fe4-0269-431d-bb9f-4fbc9c6cbac2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.259272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4fe4-0269-431d-bb9f-4fbc9c6cbac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.346183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-932c4fe4-0269-431d-bb9f-4fbc9c6cbac2 None None] MFA Rules not processed for user `71c948885da849b299c87fef651aa4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:27.348438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-932c4fe4-0269-431d-bb9f-4fbc9c6cbac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:27.524702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1082/2126] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:27.536484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:27.538371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:27.612468 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5af83-625b-497e-9e27-967414e2ff8b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:27.618742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:27.619328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.619596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.620051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.630231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:27.631680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:27.649157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1045/2127] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:27.680267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4fe4-0269-431d-bb9f-4fbc9c6cbac2 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:27.728032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:27.763170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:27.764685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:27.777861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4fe4-0269-431d-bb9f-4fbc9c6cbac2 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:27.784009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea4dbb-d08d-45ca-aa6d-c69b430c4a63 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:27.787666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:27.791363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.791738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.792239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] PATH_INFO: `/v3/users/71c948885da849b299c87fef651aa4a7` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.792983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:27.793815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.794199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.794407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c948885da849b299c87fef651aa4a7)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:27.794517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] PATH_INFO: `/v3/projects/ff3cb4edfcbb419cb4c1001873a23350` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.795784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3cb4edfcbb419cb4c1001873a23350)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:27.796737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:27.797858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:27.856345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c948885da849b299c87fef651aa4a7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.863409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:27.866299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3cb4edfcbb419cb4c1001873a23350', 'request_id': 'req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.874630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c948885da849b299c87fef651aa4a7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.875588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c948885da849b299c87fef651aa4a7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.876409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c948885da849b299c87fef651aa4a7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.876727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3cb4edfcbb419cb4c1001873a23350', 'request_id': 'req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.884220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3cb4edfcbb419cb4c1001873a23350', 'request_id': 'req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.886272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-559e3d25-b47e-4d62-b389-4465852bab23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c948885da849b299c87fef651aa4a7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.895379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] The token cache is being invalidate because project ff3cb4edfcbb419cb4c1001873a23350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:27.895657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.896310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:27.898727 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1046/2128] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:27 2022] DELETE /identity/v3/projects/ff3cb4edfcbb419cb4c1001873a23350 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:27.901532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1083/2129] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:27 2022] DELETE /identity/v3/users/71c948885da849b299c87fef651aa4a7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:27.902880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:27.904569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:27.905919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:27.906245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:27.906494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:27.924801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:27.926076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:27.984205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5cf5-96b8-49b3-bc6e-aea0a351426b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:28.004848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1084/2130] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:28.018273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:28.021124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:28.061510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:28.062393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.062675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.063633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] PATH_INFO: `/v3/users/94053173eb4c48d09a3344a3193979db` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.065055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94053173eb4c48d09a3344a3193979db)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:28.067230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:28.083171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:28.093007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b53f9-8cf1-4d58-af5f-6d522e12791a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:28.102477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:28.103532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.106669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.106669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.116060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:28.117577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:28.128719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1085/2131] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:28.129000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94053173eb4c48d09a3344a3193979db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.144835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94053173eb4c48d09a3344a3193979db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.145609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94053173eb4c48d09a3344a3193979db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.146246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94053173eb4c48d09a3344a3193979db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.153776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94053173eb4c48d09a3344a3193979db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.168488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:28.173900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1047/2132] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:27 2022] DELETE /identity/v3/users/94053173eb4c48d09a3344a3193979db => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:28.464020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:28.465579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:28.484134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90d07-e589-43b8-91eb-35320874b7cc service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:28.491155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:28.493320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:28.631645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:28.633151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.633443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.633725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] PATH_INFO: `/v3/projects/d649501a1cfa403bad8d3c61779fdd0e` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.634171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77252d6-b906-427e-b262-b462818acb95 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:28.635082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d649501a1cfa403bad8d3c61779fdd0e)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:28.637074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:28.641076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:28.642209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.642509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.643648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] PATH_INFO: `/v3/projects/4d1a5b33c33e4e909175fa823ec30951` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.646149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1a5b33c33e4e909175fa823ec30951)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:28.649388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:28.719577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd649501a1cfa403bad8d3c61779fdd0e', 'request_id': 'req-faefbd3c-8646-456c-836d-b5ee59b88fc3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.730637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd649501a1cfa403bad8d3c61779fdd0e', 'request_id': 'req-faefbd3c-8646-456c-836d-b5ee59b88fc3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.736367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1a5b33c33e4e909175fa823ec30951', 'request_id': 'req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.741914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd649501a1cfa403bad8d3c61779fdd0e', 'request_id': 'req-faefbd3c-8646-456c-836d-b5ee59b88fc3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.749002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1a5b33c33e4e909175fa823ec30951', 'request_id': 'req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.756562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] The token cache is being invalidate because project d649501a1cfa403bad8d3c61779fdd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:28.757055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.757966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faefbd3c-8646-456c-836d-b5ee59b88fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.759758 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1a5b33c33e4e909175fa823ec30951', 'request_id': 'req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.760506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1086/2133] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:28 2022] DELETE /identity/v3/projects/d649501a1cfa403bad8d3c61779fdd0e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:28.770270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cec160-1c36-4553-8f3a-52654169256a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.770631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cec160-1c36-4553-8f3a-52654169256a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.770955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cec160-1c36-4553-8f3a-52654169256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.773218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] The token cache is being invalidate because project 4d1a5b33c33e4e909175fa823ec30951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:28.774253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.777991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.777991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1048/2134] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:28 2022] DELETE /identity/v3/projects/4d1a5b33c33e4e909175fa823ec30951 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:28.777991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:28.779308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:28.795594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-99cec160-1c36-4553-8f3a-52654169256a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:28.797172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-99cec160-1c36-4553-8f3a-52654169256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:28.868383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebd03e-3341-4bbc-ae3c-a6c8c4743e4e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:28.877126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:28.877126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.877126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.877126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] PATH_INFO: `/v3/users/a0d0ffc53bd74add887c9557d1d5bca3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.878625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d0ffc53bd74add887c9557d1d5bca3)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:28.880688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:28.886467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1087/2135] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:28.888962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dbc40-822f-441c-b91f-01ebb3250ca7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.888962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dbc40-822f-441c-b91f-01ebb3250ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.888962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dbc40-822f-441c-b91f-01ebb3250ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.920093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9b9dbc40-822f-441c-b91f-01ebb3250ca7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:28.922404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9b9dbc40-822f-441c-b91f-01ebb3250ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:28.939272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:28.939726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1088/2136] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:28.949020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ea58c-dabe-4998-a911-d94a8289af52 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.949020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ea58c-dabe-4998-a911-d94a8289af52 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.949020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ea58c-dabe-4998-a911-d94a8289af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.967108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d0ffc53bd74add887c9557d1d5bca3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.973426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-de3ea58c-dabe-4998-a911-d94a8289af52 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:28.975528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-de3ea58c-dabe-4998-a911-d94a8289af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:28.982060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d0ffc53bd74add887c9557d1d5bca3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.982892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d0ffc53bd74add887c9557d1d5bca3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.983578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d0ffc53bd74add887c9557d1d5bca3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:28.991081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1089/2137] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:28.991081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd86e9-a61d-4cd6-9a0e-3f5628b8b102 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:28.991081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd86e9-a61d-4cd6-9a0e-3f5628b8b102 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:28.991428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd86e9-a61d-4cd6-9a0e-3f5628b8b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:28.994561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d0ffc53bd74add887c9557d1d5bca3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:29.004888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:29.011048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1049/2138] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:28 2022] DELETE /identity/v3/users/a0d0ffc53bd74add887c9557d1d5bca3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:29.013704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9dfd86e9-a61d-4cd6-9a0e-3f5628b8b102 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:29.014867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.016298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9dfd86e9-a61d-4cd6-9a0e-3f5628b8b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.016441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.083035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1090/2139] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:29.084346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062e7fe-5d49-4a80-93ff-676acda17481 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.084634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062e7fe-5d49-4a80-93ff-676acda17481 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.085066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062e7fe-5d49-4a80-93ff-676acda17481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.096383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08337f2-2485-4e62-8b7e-c60141dd37d1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.101375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.102048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.102331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.102609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.103389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:29.103694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.103920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1062e7fe-5d49-4a80-93ff-676acda17481 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:29.105148 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1062e7fe-5d49-4a80-93ff-676acda17481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.105362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.113106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1091/2140] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:29.115407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062e7fe-5d49-4a80-93ff-676acda17481 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.122270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1050/2141] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:29.122508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.125357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.128697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062e7fe-5d49-4a80-93ff-676acda17481 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.134634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.135353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.135803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.136090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.136832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:29.137143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.138840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.152036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1092/2142] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:29.152918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.163237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e481-12e3-4d55-a949-36603549f0d1 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.169183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.170135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.170650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.170966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.171674 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.173884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.196242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52f9b-8243-4f95-9b6b-5e621535d449 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.201095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.201708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.201991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.202265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.206820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1093/2143] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:29.206820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.213626 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.215120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.225646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1051/2144] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:29.226558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.238561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9e66f-fca6-4aeb-8172-9ba12b5d2a0f service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.282393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e628d8-dd24-464b-9397-48831321e019 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.287529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.288211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.288493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.289025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.289668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.292740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.299067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:29.324211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.325477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.325749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.327104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.328658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.332224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1094/2145] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:29.332397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.333371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.359171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1052/2146] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:29.363479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.378229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576988f8-5a96-44a5-9991-a3ae75579aab admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.447249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:29.468607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e20e-a98e-4065-b78e-e110f4206de7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.475749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.476609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.476963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.477311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.478102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.480216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.483624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.484538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.484989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.485426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.486449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.488474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.508918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1053/2147] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:29.510168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.513094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1095/2148] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:29.518348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.523678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc349b-802c-45e8-b1ae-c2c99d0bc91a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.530875 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.531747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dc137-e704-4023-af26-d857f16922aa admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.531867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.531867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.532825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.533774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.535908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.536199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.537297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.537297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.537499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.538252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.540197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.555076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1096/2149] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:29.555279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1054/2150] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:29.557426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.561721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.571682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f79bb-fb98-4002-8b27-d1669a6475f3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.579237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.579924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.580838 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.581173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.582094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.584135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.590946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96291c-1aff-43f5-9169-3fbe02533446 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.597228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.598308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.598599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.598919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] PATH_INFO: `/v3/projects/c5e4dbcb3822498da4c5780278caf3f6/users/a2d585e210b94e95888bb60cdc4c042a/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.604324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1097/2151] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:29.606778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.623275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e4dbcb3822498da4c5780278caf3f6, user_id=a2d585e210b94e95888bb60cdc4c042a, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.626270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.629317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e038e-985c-4c4e-bc55-b005aa130bd3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.636357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2a9f4-c793-4a04-8158-1e393a271a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.637669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a9f4-c793-4a04-8158-1e393a271a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.639102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a9f4-c793-4a04-8158-1e393a271a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.640432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a9f4-c793-4a04-8158-1e393a271a6c admin admin] PATH_INFO: `/v3/projects/6a69090def704fc38e1758c5fccbf7e8/users/a2833d38a57142d7a2fb9fc28ee06728/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.658909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1055/2152] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:29 2022] PUT /identity/v3/projects/c5e4dbcb3822498da4c5780278caf3f6/users/a2d585e210b94e95888bb60cdc4c042a/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:29.671251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2a9f4-c793-4a04-8158-1e393a271a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a69090def704fc38e1758c5fccbf7e8, user_id=a2833d38a57142d7a2fb9fc28ee06728, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.671389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.671476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2a9f4-c793-4a04-8158-1e393a271a6c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.674130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.689716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1098/2153] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:29 2022] PUT /identity/v3/projects/6a69090def704fc38e1758c5fccbf7e8/users/a2833d38a57142d7a2fb9fc28ee06728/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:29.690926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b6b0-5643-4f11-b3a9-b16a814deade None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.691319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b6b0-5643-4f11-b3a9-b16a814deade None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.691717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b6b0-5643-4f11-b3a9-b16a814deade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.731176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4ff8b6b0-5643-4f11-b3a9-b16a814deade None None] MFA Rules not processed for user `a2d585e210b94e95888bb60cdc4c042a`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:29.732509 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4ff8b6b0-5643-4f11-b3a9-b16a814deade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.768502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50e61-7516-400b-b048-a4a469907f3d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:29.826517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1099/2154] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:29.828037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.828390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.828813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.833295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:29.855673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:29.856679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:29.856964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:29.857243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] PATH_INFO: `/v3/projects/af27b41717524d7f826ed8499acbc7d3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:29.858489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af27b41717524d7f826ed8499acbc7d3)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:29.860482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:29.861611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] MFA Rules not processed for user `a2833d38a57142d7a2fb9fc28ee06728`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:29.862872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.932911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af27b41717524d7f826ed8499acbc7d3', 'request_id': 'req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:29.942562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af27b41717524d7f826ed8499acbc7d3', 'request_id': 'req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:29.948515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1100/2155] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:29.949451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.953089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af27b41717524d7f826ed8499acbc7d3', 'request_id': 'req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:29.953243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.966585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] The token cache is being invalidate because project af27b41717524d7f826ed8499acbc7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:29.966909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:29.967632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:29.969231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1056/2156] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:29 2022] DELETE /identity/v3/projects/af27b41717524d7f826ed8499acbc7d3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:29.971454 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:29.974833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:29.978934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:30.049751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3700d6-6ea2-415b-afb6-acc51ec5e920 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.071431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1e648-b40e-4d7d-b871-43b0ab81f36f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.079491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.080313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.080708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.081076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.082409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.084819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.119909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1057/2157] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:29 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:30.120798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.123839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.124628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:30.124961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.125356 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.126559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.130725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:30.209435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.211882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.217957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed831e0-0a1b-4344-8ec0-1ac5ed5b1390 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.223600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.224069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.224351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.224629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] PATH_INFO: `/v3/users/0b47d0e65e08424faf6304374fb249db` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.226027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b47d0e65e08424faf6304374fb249db)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.227176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1101/2158] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:30.228587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.229596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.230622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:30.248431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba050aff-f1ef-4768-b67d-2c3019a27636 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.255341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.256464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.256880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.257803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.259861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.263248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.294452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b47d0e65e08424faf6304374fb249db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:30.299984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1102/2159] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:30 2022] POST /identity/v3/users => generated 289 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:30.306580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.311785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b47d0e65e08424faf6304374fb249db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:30.313024 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b47d0e65e08424faf6304374fb249db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:30.314318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b47d0e65e08424faf6304374fb249db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:30.324074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d9d14-efd6-4933-a8f9-4a513a43aabe admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.329419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.330177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.330473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.330781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.331753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b47d0e65e08424faf6304374fb249db'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:30.331988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.333685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.348367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1103/2160] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:30.353153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.355398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:30.355853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1058/2161] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:30 2022] DELETE /identity/v3/users/0b47d0e65e08424faf6304374fb249db => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:30.380455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365b11c-f8dc-437a-aa8c-c6b8619f5150 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.471545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:30.490408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.495652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.495652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.495652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] PATH_INFO: `/v3/projects/0a2511715373468f83c5f08d067298dd/users/626a247bf9f443b186c4b892cb1430c0/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.517295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2511715373468f83c5f08d067298dd, user_id=626a247bf9f443b186c4b892cb1430c0, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.521006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.547681 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1104/2162] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:30 2022] PUT /identity/v3/projects/0a2511715373468f83c5f08d067298dd/users/626a247bf9f443b186c4b892cb1430c0/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:30.549194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.567670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b624e-8d56-4927-8502-cfb47515d842 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.664464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3314db-ffd9-4ea3-a82d-a67c2939b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.665291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3314db-ffd9-4ea3-a82d-a67c2939b2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.665507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3314db-ffd9-4ea3-a82d-a67c2939b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.665745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3314db-ffd9-4ea3-a82d-a67c2939b2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.666528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3314db-ffd9-4ea3-a82d-a67c2939b2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.668183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3314db-ffd9-4ea3-a82d-a67c2939b2d0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.690133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1059/2163] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:30.700168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.720017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fecbdb-6eab-4bbe-9cdc-c8d86c1a07ae admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.739170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.740263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.740558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.740840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] PATH_INFO: `/v3/projects/0a2511715373468f83c5f08d067298dd/users/626a247bf9f443b186c4b892cb1430c0/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.745582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2511715373468f83c5f08d067298dd, user_id=626a247bf9f443b186c4b892cb1430c0, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.749245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.772582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1105/2164] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:30 2022] PUT /identity/v3/projects/0a2511715373468f83c5f08d067298dd/users/626a247bf9f443b186c4b892cb1430c0/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:30.786459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.788686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.788686 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.811839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.813935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:30.840762 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] MFA Rules not processed for user `626a247bf9f443b186c4b892cb1430c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:30.842680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:30.962780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:30.963837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80fe3-f6b2-4377-ad26-21b8b54c153a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:30.973327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1060/2165] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:30.976926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:30.976926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:30.976926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:30.977412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] PATH_INFO: `/v3/projects/510ea1a949734260afdd88499cfd4015` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:30.984222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=510ea1a949734260afdd88499cfd4015)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:30.986571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:30.987073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:30.989228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:31.064669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510ea1a949734260afdd88499cfd4015', 'request_id': 'req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:31.075844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510ea1a949734260afdd88499cfd4015', 'request_id': 'req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:31.085907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510ea1a949734260afdd88499cfd4015', 'request_id': 'req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:31.089169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1af959-335a-4aca-b23e-1bb6da0c4bf5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.099333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] The token cache is being invalidate because project 510ea1a949734260afdd88499cfd4015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:31.099624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:31.100324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-12f69045-e3d9-4e8d-9e6e-9f716bff0bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:31.102868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1106/2166] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:30 2022] DELETE /identity/v3/projects/510ea1a949734260afdd88499cfd4015 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:31.107506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f639dc-05ab-44c1-b6f9-c65f150d3fc3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.107799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f639dc-05ab-44c1-b6f9-c65f150d3fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.108135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f639dc-05ab-44c1-b6f9-c65f150d3fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.127698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a6f639dc-05ab-44c1-b6f9-c65f150d3fc3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:31.128928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a6f639dc-05ab-44c1-b6f9-c65f150d3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:31.153558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.154603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.155145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.155624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.159630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:31.181689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:31.196421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1107/2167] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:31.209585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509870-029a-41d7-aa42-1305b1ac087a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.210679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509870-029a-41d7-aa42-1305b1ac087a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.210998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509870-029a-41d7-aa42-1305b1ac087a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.230272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2b509870-029a-41d7-aa42-1305b1ac087a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:31.231717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2b509870-029a-41d7-aa42-1305b1ac087a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:31.235825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.237320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.240108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1108/2168] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:31.245230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509870-029a-41d7-aa42-1305b1ac087a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.250716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1061/2169] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:31.255637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509870-029a-41d7-aa42-1305b1ac087a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.261761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.262563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.262997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.263343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.264084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:31.264473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.266253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.281781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1109/2170] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:31.286952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.301539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc66e8-140a-4833-871f-1b9cbb8e48af service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.312735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.313721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.318190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.318561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.319356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.321683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.357752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1062/2171] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:31 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:31.357928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.359133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:31.359415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.373259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3a5b7-e00d-4c1f-931e-cbe58b03c9a2 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.411301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:31.428046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.428717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.429005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.429310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.432077 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:31.434192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eb8a1-83e5-4ccb-9066-f7e705ca3002 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.439773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.440305 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.440543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.440816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.441715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.443735 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.471278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1063/2172] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:31 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:31.472061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.482902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c3d5-3491-4b48-9e71-7eb622f08f88 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.489787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.490483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.490810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.491087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.491838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.493501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.506900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1064/2173] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:31.519819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.527743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.528871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.534902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c91f9-88c3-42be-8c6c-7aa28f56de9d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.544023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1110/2174] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:31.546779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301875d1-9906-4d9f-b98b-1f294fcfad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.548160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301875d1-9906-4d9f-b98b-1f294fcfad18 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.548160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301875d1-9906-4d9f-b98b-1f294fcfad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.548376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301875d1-9906-4d9f-b98b-1f294fcfad18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.549244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301875d1-9906-4d9f-b98b-1f294fcfad18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.550954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301875d1-9906-4d9f-b98b-1f294fcfad18 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.563868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1065/2175] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:31.569648 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.581234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92b269-de85-4c4c-befa-c5e76b78b00c service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.586543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.587573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.587864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.588229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] PATH_INFO: `/v3/projects/b8d154e446554e3d877cd6648a357cb0/users/91aed7586af4431fa007c0af683a5099/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.610182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d154e446554e3d877cd6648a357cb0, user_id=91aed7586af4431fa007c0af683a5099, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.613142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.629695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1111/2176] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:31 2022] PUT /identity/v3/projects/b8d154e446554e3d877cd6648a357cb0/users/91aed7586af4431fa007c0af683a5099/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:31.642462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fc5f-6bbf-40f0-b819-297cd2171da2 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.642978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fc5f-6bbf-40f0-b819-297cd2171da2 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.643459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fc5f-6bbf-40f0-b819-297cd2171da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.686668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8f39fc5f-6bbf-40f0-b819-297cd2171da2 None None] MFA Rules not processed for user `91aed7586af4431fa007c0af683a5099`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:31.688221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8f39fc5f-6bbf-40f0-b819-297cd2171da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:31.770484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1066/2177] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:31.777319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.854928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0060b-52e9-4fbe-a072-afcf3f5d5d1d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:31.859897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:31.860566 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:31.860853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:31.861129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:31.861985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:31.863946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:31.880663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:31.901639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1112/2178] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:31 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:31.906710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fc5f-6bbf-40f0-b819-297cd2171da2 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:31.934373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fc5f-6bbf-40f0-b819-297cd2171da2 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:32.005871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:32.006471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:32.006786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:32.007064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:32.008359 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:32.011613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:32.039178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1067/2179] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:31 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:32.043993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:32.054866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ca6bf-33f0-421f-81a6-9a3d57078fa3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:32.059991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:32.060828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:32.061152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:32.061429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:32.062173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:32.063913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:32.079847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1113/2180] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:32.084322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:32.126353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f1fe7-31ed-439e-a04f-527c393ee1af admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:32.139283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:32.140741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:32.141154 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:32.141753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] PATH_INFO: `/v3/projects/a2ee91fa73274eb1bfc56b327633ed4e/users/fecbc0bf9e8a4e96a7adfe43e0e499b3/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:32.164187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ee91fa73274eb1bfc56b327633ed4e, user_id=fecbc0bf9e8a4e96a7adfe43e0e499b3, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:32.166944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:32.195987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1068/2181] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:32 2022] PUT /identity/v3/projects/a2ee91fa73274eb1bfc56b327633ed4e/users/fecbc0bf9e8a4e96a7adfe43e0e499b3/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:32.199975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:32.212740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32250442-81aa-4aaf-8551-0e66aeb9aeca admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:32.301826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4fa20-502b-4cf7-bd7b-546d040a206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:32.302507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4fa20-502b-4cf7-bd7b-546d040a206b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:32.302821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4fa20-502b-4cf7-bd7b-546d040a206b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:32.303098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4fa20-502b-4cf7-bd7b-546d040a206b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:32.303881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4fa20-502b-4cf7-bd7b-546d040a206b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:32.306193 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4fa20-502b-4cf7-bd7b-546d040a206b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:32.317135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1114/2182] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:32.321780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:32.333231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3001cd-c4ae-4113-b2b8-2c884490a627 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:32.338584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:32.339506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:32.339784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:32.340057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] PATH_INFO: `/v3/projects/a2ee91fa73274eb1bfc56b327633ed4e/users/fecbc0bf9e8a4e96a7adfe43e0e499b3/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:32.342068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ee91fa73274eb1bfc56b327633ed4e, user_id=fecbc0bf9e8a4e96a7adfe43e0e499b3, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:32.344913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:32.347464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:32.357869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1069/2183] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:32 2022] PUT /identity/v3/projects/a2ee91fa73274eb1bfc56b327633ed4e/users/fecbc0bf9e8a4e96a7adfe43e0e499b3/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:32.369529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74a0f6-4386-4f4e-8647-f0e709240b58 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:32.369817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74a0f6-4386-4f4e-8647-f0e709240b58 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:32.370096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74a0f6-4386-4f4e-8647-f0e709240b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:32.399860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-fb74a0f6-4386-4f4e-8647-f0e709240b58 None None] MFA Rules not processed for user `fecbc0bf9e8a4e96a7adfe43e0e499b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:32.401089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-fb74a0f6-4386-4f4e-8647-f0e709240b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:32.472515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1115/2184] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:32.487410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:32.489143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:32.549701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89ea6c-1dee-4ac8-8434-393ede0c0550 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:32.553439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04eef32-199f-40ce-ab45-35f5f11fe09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:32.554106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eef32-199f-40ce-ab45-35f5f11fe09a service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:32.554449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eef32-199f-40ce-ab45-35f5f11fe09a service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:32.554746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04eef32-199f-40ce-ab45-35f5f11fe09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:32.566149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04eef32-199f-40ce-ab45-35f5f11fe09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:32.568183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04eef32-199f-40ce-ab45-35f5f11fe09a service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:32.580129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1070/2185] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:33.287982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74a0f6-4386-4f4e-8647-f0e709240b58 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:33.378746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74a0f6-4386-4f4e-8647-f0e709240b58 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:33.383599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:33.384544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:33.385446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:33.385446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] PATH_INFO: `/v3/users/91aed7586af4431fa007c0af683a5099` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:33.386728 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=91aed7586af4431fa007c0af683a5099)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:33.392661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:33.399849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:33.468657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91aed7586af4431fa007c0af683a5099'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:33.498212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91aed7586af4431fa007c0af683a5099'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:33.499022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91aed7586af4431fa007c0af683a5099'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:33.499801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91aed7586af4431fa007c0af683a5099'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:33.509858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91aed7586af4431fa007c0af683a5099'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:33.542126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1116/2186] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:33 2022] DELETE /identity/v3/users/91aed7586af4431fa007c0af683a5099 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:33.547249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:33.547760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:33.547873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:33.567688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:33.568814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:33.671375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1071/2187] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:33.684178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:33.686858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:33.776600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc450cb-40c2-4dcf-8332-5cbc5aa63cbd admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:33.780503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:33.781223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:33.781642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:33.781790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:33.792265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:33.793733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:33.804063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1117/2188] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:34.114566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:34.116569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:34.137119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd7ac2-c9ca-4bce-b2ee-3e4e9e35bff8 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:34.158569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:34.159548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:34.159896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:34.160180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] PATH_INFO: `/v3/projects/b8d154e446554e3d877cd6648a357cb0` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:34.161408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d154e446554e3d877cd6648a357cb0)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:34.163422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:34.222464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d154e446554e3d877cd6648a357cb0', 'request_id': 'req-cdcab84b-387b-4291-9c0a-4c8446769d2d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.231710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d154e446554e3d877cd6648a357cb0', 'request_id': 'req-cdcab84b-387b-4291-9c0a-4c8446769d2d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.238771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d154e446554e3d877cd6648a357cb0', 'request_id': 'req-cdcab84b-387b-4291-9c0a-4c8446769d2d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.250149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] The token cache is being invalidate because project b8d154e446554e3d877cd6648a357cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:34.250446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.251148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.252900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1072/2189] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:34 2022] DELETE /identity/v3/projects/b8d154e446554e3d877cd6648a357cb0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:34.258273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:34.271502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed92df-a392-4e56-9efc-00a97ee15334 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:34.363869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:34.364699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:34.364985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:34.365261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] PATH_INFO: `/v3/users/fecbc0bf9e8a4e96a7adfe43e0e499b3` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:34.366522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fecbc0bf9e8a4e96a7adfe43e0e499b3)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:34.370074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:34.401764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:34.425116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fecbc0bf9e8a4e96a7adfe43e0e499b3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.442158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fecbc0bf9e8a4e96a7adfe43e0e499b3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.442992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fecbc0bf9e8a4e96a7adfe43e0e499b3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.443700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fecbc0bf9e8a4e96a7adfe43e0e499b3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.451733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-865e219f-fb30-4cd3-8547-8f05421fd262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fecbc0bf9e8a4e96a7adfe43e0e499b3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:34.467345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1118/2190] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:34 2022] DELETE /identity/v3/users/fecbc0bf9e8a4e96a7adfe43e0e499b3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:34.876146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:34.877832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:34.912485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab84b-387b-4291-9c0a-4c8446769d2d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:34.953950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:35.022999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.024591 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.024969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.025420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] PATH_INFO: `/v3/projects/a2ee91fa73274eb1bfc56b327633ed4e` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.027560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ee91fa73274eb1bfc56b327633ed4e)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.029660 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.103728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ee91fa73274eb1bfc56b327633ed4e', 'request_id': 'req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:35.114550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ee91fa73274eb1bfc56b327633ed4e', 'request_id': 'req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:35.124927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ee91fa73274eb1bfc56b327633ed4e', 'request_id': 'req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:35.149745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] The token cache is being invalidate because project a2ee91fa73274eb1bfc56b327633ed4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:35.150183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:35.151028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e9fb3c24-b692-43da-8048-3d5e55a8d7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:35.153112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1073/2191] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:34 2022] DELETE /identity/v3/projects/a2ee91fa73274eb1bfc56b327633ed4e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:35.159702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d21ca-0f28-41e9-99bd-17bff68b14b7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.159994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d21ca-0f28-41e9-99bd-17bff68b14b7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.160606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d21ca-0f28-41e9-99bd-17bff68b14b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.188291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-618d21ca-0f28-41e9-99bd-17bff68b14b7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:35.195452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-618d21ca-0f28-41e9-99bd-17bff68b14b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:35.287828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1119/2192] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:35.296353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e45c6-a9a8-4c83-b2c9-305af6b4252c None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.296657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e45c6-a9a8-4c83-b2c9-305af6b4252c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.296929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e45c6-a9a8-4c83-b2c9-305af6b4252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.316226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-178e45c6-a9a8-4c83-b2c9-305af6b4252c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:35.317437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-178e45c6-a9a8-4c83-b2c9-305af6b4252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:35.327460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1074/2193] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:35.332103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d21ca-0f28-41e9-99bd-17bff68b14b7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:35.343826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d21ca-0f28-41e9-99bd-17bff68b14b7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:35.348786 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0561-831b-46b9-a611-95693331358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.349459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0561-831b-46b9-a611-95693331358c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.349739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0561-831b-46b9-a611-95693331358c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.350016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c0561-831b-46b9-a611-95693331358c admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.350770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0561-831b-46b9-a611-95693331358c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:35.351091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0561-831b-46b9-a611-95693331358c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.353360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c0561-831b-46b9-a611-95693331358c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.365726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1120/2194] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:35.370266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e45c6-a9a8-4c83-b2c9-305af6b4252c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:35.382621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e45c6-a9a8-4c83-b2c9-305af6b4252c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:35.387906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.388506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.388795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.389073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.389787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.391787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.426861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1075/2195] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:35 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:35.429429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0561-831b-46b9-a611-95693331358c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:35.440829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c0561-831b-46b9-a611-95693331358c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:35.522651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.523894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.524177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.524450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.525141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.527093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.551885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1121/2196] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:35 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:35.556012 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:35.566944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1b66-c9d0-43b1-a6f0-5b538c7f652c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:35.572307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.573235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.573778 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.574112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.575439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.578275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.593582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1076/2197] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:35.597744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:35.609653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e755fa2-25fd-4e90-9cb5-6743b514df43 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:35.617511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36a2fd-940a-4a75-9764-a1359526ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.618235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36a2fd-940a-4a75-9764-a1359526ea14 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.618510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36a2fd-940a-4a75-9764-a1359526ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.618807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36a2fd-940a-4a75-9764-a1359526ea14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.619545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36a2fd-940a-4a75-9764-a1359526ea14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.621157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36a2fd-940a-4a75-9764-a1359526ea14 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.635209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1122/2198] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:35.639444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:35.650414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d5791-74bc-45c6-9fe2-2a3b6b2a2f5d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:35.655593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.656492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.656776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.657054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] PATH_INFO: `/v3/projects/66046d779eaf498eb5a7d0049693501d/users/5286d127b7e449f4b05a01df70dee291/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.674748 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66046d779eaf498eb5a7d0049693501d, user_id=5286d127b7e449f4b05a01df70dee291, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.680440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.696383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1077/2199] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:35 2022] PUT /identity/v3/projects/66046d779eaf498eb5a7d0049693501d/users/5286d127b7e449f4b05a01df70dee291/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:35.701815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3e63-87d0-4d18-854c-82e330e64f58 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.702101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3e63-87d0-4d18-854c-82e330e64f58 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.702378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3e63-87d0-4d18-854c-82e330e64f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.722380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e6ad3e63-87d0-4d18-854c-82e330e64f58 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:35.723658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e6ad3e63-87d0-4d18-854c-82e330e64f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:35.728095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:35.797046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1123/2200] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:35.808722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:35.810585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:35.881497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:35.887879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de83546-e202-421e-b91e-ee9a0098615b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:35.894489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:35.895525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:35.896051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:35.896789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:35.908284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:35.910218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:35.923874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1078/2201] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:36.766730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fa796-9c8b-430a-8553-4edbe9f14a9e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:36.767616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fa796-9c8b-430a-8553-4edbe9f14a9e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:36.767904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fa796-9c8b-430a-8553-4edbe9f14a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:36.800613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b66fa796-9c8b-430a-8553-4edbe9f14a9e None None] MFA Rules not processed for user `5286d127b7e449f4b05a01df70dee291`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:36.802158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b66fa796-9c8b-430a-8553-4edbe9f14a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:36.901981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1124/2202] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:36.906279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:36.917208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84823f-5aac-47a1-b031-307f7e11563e service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:36.931222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:36.933973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:36.934229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:36.935015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:36.936341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:36.939470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:36.975915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1079/2203] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:36 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:36.977981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fa796-9c8b-430a-8553-4edbe9f14a9e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:36.989455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fa796-9c8b-430a-8553-4edbe9f14a9e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:37.065138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:37.066273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:37.066735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:37.067091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:37.067878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:37.076596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:37.108660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1125/2204] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:36 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:37.112528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:37.124365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51b62d-1d11-4877-bdc0-60a98daf3319 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:37.129964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:37.130648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:37.130970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:37.131246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:37.132023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:37.133886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:37.147803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1080/2205] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:37.152048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:37.167795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fc20f-3090-42e2-ae07-51db7ad3add8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:37.181132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:37.182305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:37.182305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:37.183230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] PATH_INFO: `/v3/projects/070d69c61c534edab9dd97a3dcfb7c00/users/a2aff07d6e434e288038ad232f0281e1/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:37.200256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=070d69c61c534edab9dd97a3dcfb7c00, user_id=a2aff07d6e434e288038ad232f0281e1, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:37.203038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:37.230397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1126/2206] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:37 2022] PUT /identity/v3/projects/070d69c61c534edab9dd97a3dcfb7c00/users/a2aff07d6e434e288038ad232f0281e1/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:37.233084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:37.245317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20301ccc-3c98-456d-bacf-14be7c4cc6d1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:37.347274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2903a-91b4-42c7-a5bd-f5dbd282c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:37.348794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2903a-91b4-42c7-a5bd-f5dbd282c7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:37.349267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2903a-91b4-42c7-a5bd-f5dbd282c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:37.349736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2903a-91b4-42c7-a5bd-f5dbd282c7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:37.351004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2903a-91b4-42c7-a5bd-f5dbd282c7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:37.354225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2903a-91b4-42c7-a5bd-f5dbd282c7f1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:37.373671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1081/2207] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:37.379597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:37.387318 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:37.391866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079822-31f7-46f6-a87a-f79c34fcd76d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:37.408104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:37.409011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:37.409328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:37.409760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] PATH_INFO: `/v3/projects/070d69c61c534edab9dd97a3dcfb7c00/users/a2aff07d6e434e288038ad232f0281e1/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:37.411906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070d69c61c534edab9dd97a3dcfb7c00, user_id=a2aff07d6e434e288038ad232f0281e1, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:37.415675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:37.430123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1127/2208] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:37 2022] PUT /identity/v3/projects/070d69c61c534edab9dd97a3dcfb7c00/users/a2aff07d6e434e288038ad232f0281e1/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:38.150488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb74d8-0d32-444e-92be-0c31bb74cd82 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:38.151193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb74d8-0d32-444e-92be-0c31bb74cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:38.151193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb74d8-0d32-444e-92be-0c31bb74cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:38.178208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-fedb74d8-0d32-444e-92be-0c31bb74cd82 None None] MFA Rules not processed for user `a2aff07d6e434e288038ad232f0281e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:38.179500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fedb74d8-0d32-444e-92be-0c31bb74cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:38.268091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1082/2209] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:38.280590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:38.282874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:38.362946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33f86-cfa6-4749-b9b9-448a02f02e82 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:38.376142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:38.377030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:38.377441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:38.377954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:38.468523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:38.469981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:38.480560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1128/2210] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:39.887532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb74d8-0d32-444e-92be-0c31bb74cd82 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:39.903206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb74d8-0d32-444e-92be-0c31bb74cd82 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:39.907790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974dafc-02f4-493e-a6d9-702c05623598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:39.908593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974dafc-02f4-493e-a6d9-702c05623598 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:39.908871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974dafc-02f4-493e-a6d9-702c05623598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:39.909145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974dafc-02f4-493e-a6d9-702c05623598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:39.919546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974dafc-02f4-493e-a6d9-702c05623598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:39.921000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974dafc-02f4-493e-a6d9-702c05623598 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:39.932606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1083/2211] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:42.045480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:42.047208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:42.174873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11c222-98cd-4bd6-afa7-218facf6e44e service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:42.180382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:42.181259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:42.181539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:42.181811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] PATH_INFO: `/v3/users/a2d585e210b94e95888bb60cdc4c042a` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:42.183066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d585e210b94e95888bb60cdc4c042a)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:42.185002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:42.241195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d585e210b94e95888bb60cdc4c042a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.244839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:42.263331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d585e210b94e95888bb60cdc4c042a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.264218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d585e210b94e95888bb60cdc4c042a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.265807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d585e210b94e95888bb60cdc4c042a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.273332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d585e210b94e95888bb60cdc4c042a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.290251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1129/2212] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:42 2022] DELETE /identity/v3/users/a2d585e210b94e95888bb60cdc4c042a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:42.294812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:42.295312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:42.295414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:42.315765 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:42.316972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:42.339964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:42.395562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1084/2213] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:42.405457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:42.407001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:42.514641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47e0c-61c5-4220-81dd-3d6088086156 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:42.518910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76860d94-0587-42ad-8a14-61e2cf54818d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:42.519579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76860d94-0587-42ad-8a14-61e2cf54818d service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:42.519880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76860d94-0587-42ad-8a14-61e2cf54818d service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:42.520332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76860d94-0587-42ad-8a14-61e2cf54818d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:42.534092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76860d94-0587-42ad-8a14-61e2cf54818d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:42.535921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76860d94-0587-42ad-8a14-61e2cf54818d service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:42.549141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1130/2214] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:42.579440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:42.581213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:42.603358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d92c1-1e05-49cb-bfdf-377524f1656e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:42.624389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:42.630587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:42.631491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:42.631991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] PATH_INFO: `/v3/users/a2833d38a57142d7a2fb9fc28ee06728` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:42.634870 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2833d38a57142d7a2fb9fc28ee06728)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:42.637887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:42.716713 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2833d38a57142d7a2fb9fc28ee06728'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.734715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2833d38a57142d7a2fb9fc28ee06728'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.735484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2833d38a57142d7a2fb9fc28ee06728'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.736093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2833d38a57142d7a2fb9fc28ee06728'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.747833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2833d38a57142d7a2fb9fc28ee06728'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:42.773429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1085/2215] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:42 2022] DELETE /identity/v3/users/a2833d38a57142d7a2fb9fc28ee06728 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:42.778126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:42.778442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:42.778776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:42.801689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:42.805795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:42.875227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1131/2216] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:42.885577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:42.887177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:42.922464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:42.924649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:42.945559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41eed-2720-4cd2-b839-3d987090db97 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:42.952634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:42.953756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:42.954547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:42.955013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] PATH_INFO: `/v3/projects/c5e4dbcb3822498da4c5780278caf3f6` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:42.956862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e4dbcb3822498da4c5780278caf3f6)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:42.968810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:42.998834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092ca4e-5925-4aa4-be12-a432845cc734 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.014325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e4dbcb3822498da4c5780278caf3f6', 'request_id': 'req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.028506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e4dbcb3822498da4c5780278caf3f6', 'request_id': 'req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.037140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e4dbcb3822498da4c5780278caf3f6', 'request_id': 'req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.039488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:43.051093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] The token cache is being invalidate because project c5e4dbcb3822498da4c5780278caf3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:43.052290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.053813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-2464eb02-edcb-4743-bc87-2a8ec1e6b72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.056245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1132/2217] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:42 2022] DELETE /identity/v3/projects/c5e4dbcb3822498da4c5780278caf3f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:43.063996 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115738f8-ec10-4ba4-892b-9ea0a391281b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.064289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115738f8-ec10-4ba4-892b-9ea0a391281b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.064471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.064660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115738f8-ec10-4ba4-892b-9ea0a391281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.065047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.065326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.065597 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.067377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:43.075694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:43.085856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-115738f8-ec10-4ba4-892b-9ea0a391281b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:43.087141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-115738f8-ec10-4ba4-892b-9ea0a391281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:43.150278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.151814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.160580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1133/2218] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:43.162854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1086/2219] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:43.170275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba975ed6-3782-412f-b217-dbe51a59470d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.170571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba975ed6-3782-412f-b217-dbe51a59470d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.170884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba975ed6-3782-412f-b217-dbe51a59470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.190819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ba975ed6-3782-412f-b217-dbe51a59470d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:43.192071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ba975ed6-3782-412f-b217-dbe51a59470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:43.206380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1134/2220] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:43.211281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.223559 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36125449-8a8b-44f5-a0aa-3a803126074e service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.230364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.231652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.231922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.232488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.233366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:43.233950 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.235966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.251098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1087/2221] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:43.255469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba975ed6-3782-412f-b217-dbe51a59470d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.269679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba975ed6-3782-412f-b217-dbe51a59470d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.277709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.279146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.279464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.280110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.281096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.283675 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.317818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1135/2222] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:43 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:43.323297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.349212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc12263-9804-4ecf-adbd-2af524960aec admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.417904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.418787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.419072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.419347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.420097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.422053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.444687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1088/2223] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:43 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:43.449323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.462452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0976f8-0ffb-43da-a0c9-407e7dbb569e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.467739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.468505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.468885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.469228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.470202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.471858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.485555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.486717 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1136/2224] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:43.490227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:43.490519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.503658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc4f51-7b1d-42ca-a68d-e646ecefe3cf admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.510676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.511113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaf469-38db-497f-a4f6-695a6d2a5914 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.511615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.512081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.513636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.515019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.516815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.517602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.517720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.517991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.518288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] PATH_INFO: `/v3/projects/6a69090def704fc38e1758c5fccbf7e8` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.519670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a69090def704fc38e1758c5fccbf7e8)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.521775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.531725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1137/2225] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:23:43.535672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.547143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea3ae-e11b-4e1f-8fba-b85beae82ef0 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.552644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295776d-b811-4d79-98ba-84a9afab2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.553571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295776d-b811-4d79-98ba-84a9afab2e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.555896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295776d-b811-4d79-98ba-84a9afab2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.555896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295776d-b811-4d79-98ba-84a9afab2e13 admin admin] PATH_INFO: `/v3/projects/47f188ba229a49749df2f89f8cb2d24c/users/083673f20b0e45808e542719f7f94028/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.571484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295776d-b811-4d79-98ba-84a9afab2e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f188ba229a49749df2f89f8cb2d24c, user_id=083673f20b0e45808e542719f7f94028, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.584503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a69090def704fc38e1758c5fccbf7e8', 'request_id': 'req-c1833172-dd14-4862-9f5b-426e70caa69e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.586400 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295776d-b811-4d79-98ba-84a9afab2e13 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.598175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a69090def704fc38e1758c5fccbf7e8', 'request_id': 'req-c1833172-dd14-4862-9f5b-426e70caa69e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.606218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1138/2226] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:43 2022] PUT /identity/v3/projects/47f188ba229a49749df2f89f8cb2d24c/users/083673f20b0e45808e542719f7f94028/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:23:43.607813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a69090def704fc38e1758c5fccbf7e8', 'request_id': 'req-c1833172-dd14-4862-9f5b-426e70caa69e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.620477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.620971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.621345 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.622117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] The token cache is being invalidate because project 6a69090def704fc38e1758c5fccbf7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:43.622409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.623374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.625405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1089/2227] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:43 2022] DELETE /identity/v3/projects/6a69090def704fc38e1758c5fccbf7e8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:43.629711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.632436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:43.638934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:43.664887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] MFA Rules not processed for user `083673f20b0e45808e542719f7f94028`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:43.668620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:43.770573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1833172-dd14-4862-9f5b-426e70caa69e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.773727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1139/2228] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:43.797210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:43.798844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:43.818586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:43.864233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.865288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.865669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.866043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] PATH_INFO: `/v3/users/626a247bf9f443b186c4b892cb1430c0` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.868826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626a247bf9f443b186c4b892cb1430c0)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.872918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.903962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538bc91-4246-4967-a1ec-c2e2baf54bc5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:43.911769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:43.912839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:43.913468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:43.913974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:43.932578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:43.937716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:43.953657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1140/2229] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:43.959800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626a247bf9f443b186c4b892cb1430c0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.983093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626a247bf9f443b186c4b892cb1430c0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.984387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626a247bf9f443b186c4b892cb1430c0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.986401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626a247bf9f443b186c4b892cb1430c0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:43.998913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-cd573797-31a5-479b-b4ac-3d3a2bb799a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626a247bf9f443b186c4b892cb1430c0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:44.038730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1090/2230] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:43 2022] DELETE /identity/v3/users/626a247bf9f443b186c4b892cb1430c0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:45.204771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:45.254231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a68179-77dd-4a7d-93ed-176d6fd284cd service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:45.338662 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:45.339312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.339649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.339931 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] PATH_INFO: `/v3/projects/0a2511715373468f83c5f08d067298dd` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.341128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2511715373468f83c5f08d067298dd)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:45.344068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:45.429988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2511715373468f83c5f08d067298dd', 'request_id': 'req-b99c4911-427d-4e53-b537-b89357f8018e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:45.439126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2511715373468f83c5f08d067298dd', 'request_id': 'req-b99c4911-427d-4e53-b537-b89357f8018e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:45.446362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2511715373468f83c5f08d067298dd', 'request_id': 'req-b99c4911-427d-4e53-b537-b89357f8018e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:45.458403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] The token cache is being invalidate because project 0a2511715373468f83c5f08d067298dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:45.459094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:45.460055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b99c4911-427d-4e53-b537-b89357f8018e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:45.462165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1141/2231] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:45 2022] DELETE /identity/v3/projects/0a2511715373468f83c5f08d067298dd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:45.467492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54069f8-ee90-40c8-914a-a12a13825c3c None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.468029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54069f8-ee90-40c8-914a-a12a13825c3c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.468185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54069f8-ee90-40c8-914a-a12a13825c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.490204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c54069f8-ee90-40c8-914a-a12a13825c3c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:45.492439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c54069f8-ee90-40c8-914a-a12a13825c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:45.521809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:45.579379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1091/2232] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:45.588601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac797-32f6-41e1-8526-2e71e65e2305 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.588886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac797-32f6-41e1-8526-2e71e65e2305 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.589167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac797-32f6-41e1-8526-2e71e65e2305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.637666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d1cac797-32f6-41e1-8526-2e71e65e2305 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:45.640264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d1cac797-32f6-41e1-8526-2e71e65e2305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:45.655786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54069f8-ee90-40c8-914a-a12a13825c3c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:45.665121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1142/2233] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:45.670045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54069f8-ee90-40c8-914a-a12a13825c3c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:45.680321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:45.681277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.686905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.686905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.686905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:45.686905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:45.686905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:45.700970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1092/2234] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:45.704942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cac797-32f6-41e1-8526-2e71e65e2305 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:45.717645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cac797-32f6-41e1-8526-2e71e65e2305 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:45.722774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:45.723521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.723865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.724186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.725031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:45.728051 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:45.762182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1143/2235] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:45 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:45.766193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:45.787067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fc9af-3fae-4736-ae7a-41a8831dfd57 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:45.890229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:45.890229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.890229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.890229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.890581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:45.890581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:45.917775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1093/2236] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:45 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:45.922177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:45.933620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ab767-8436-4335-8719-e6f2b0e03f12 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:45.939161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:45.939849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.940141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.940416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.943030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:45.943030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:45.948862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:45.955533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1144/2237] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:45.959629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:45.970706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a398c-fcde-42da-8302-92577504437c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:45.975639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cebebf-bd58-481c-aead-d955d5354ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:45.976868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cebebf-bd58-481c-aead-d955d5354ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:45.977151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cebebf-bd58-481c-aead-d955d5354ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:45.977425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cebebf-bd58-481c-aead-d955d5354ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:45.978157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cebebf-bd58-481c-aead-d955d5354ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:45.979860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cebebf-bd58-481c-aead-d955d5354ab0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:45.991277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1094/2238] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:45.995984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.006038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc495de-2360-4604-a946-4e853b1c1713 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.010979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.011929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.012153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.012430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] PATH_INFO: `/v3/projects/40163cd183194725a7f50630a4d2f701/users/9affaba21a6849bc8a836438426d0617/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.028076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40163cd183194725a7f50630a4d2f701, user_id=9affaba21a6849bc8a836438426d0617, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.030944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.046276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1145/2239] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:45 2022] PUT /identity/v3/projects/40163cd183194725a7f50630a4d2f701/users/9affaba21a6849bc8a836438426d0617/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:46.058341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b592c-f72a-4378-93b5-0a8aaeed5f22 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.058629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b592c-f72a-4378-93b5-0a8aaeed5f22 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.059414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b592c-f72a-4378-93b5-0a8aaeed5f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.091569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-145b592c-f72a-4378-93b5-0a8aaeed5f22 None None] MFA Rules not processed for user `9affaba21a6849bc8a836438426d0617`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:46.092910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-145b592c-f72a-4378-93b5-0a8aaeed5f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:46.211156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1095/2240] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:46.216110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.293997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c9e64-6903-4dff-bfdb-163e4b3e354c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.300466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.301130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.301415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.301688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.302401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.304449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.334197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1146/2241] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:46 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:46.339018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b592c-f72a-4378-93b5-0a8aaeed5f22 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.351025 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b592c-f72a-4378-93b5-0a8aaeed5f22 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.372949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:46.416831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.417520 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.417801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.418077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.418794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.420750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.442115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1096/2242] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:46 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:46.446445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.457288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a3da-4821-4637-a562-4b0dde7f0e17 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.462879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.463542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.463858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.464137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.464869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.466507 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.478591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1147/2243] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:46.482903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.494170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14522dc8-1922-4095-810d-dcfe02db2991 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.499013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.499905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.500191 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.500471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] PATH_INFO: `/v3/projects/332cc20ccbb94bd8bd0808f2d5dbc924/users/7e6e3d2b3ffd4d40bec9864628f5c337/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.516630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=332cc20ccbb94bd8bd0808f2d5dbc924, user_id=7e6e3d2b3ffd4d40bec9864628f5c337, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.519368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.532951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1097/2244] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:46 2022] PUT /identity/v3/projects/332cc20ccbb94bd8bd0808f2d5dbc924/users/7e6e3d2b3ffd4d40bec9864628f5c337/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:46.536983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.547577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229ac1f-1f8d-4d1c-acf4-d764bfcd9174 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.614139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e93066-2704-41f6-bf93-86bea739150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.614846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93066-2704-41f6-bf93-86bea739150c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.615128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93066-2704-41f6-bf93-86bea739150c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.615399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93066-2704-41f6-bf93-86bea739150c admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.616126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e93066-2704-41f6-bf93-86bea739150c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.619233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e93066-2704-41f6-bf93-86bea739150c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.628937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1148/2245] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:46.633807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.645534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffceb8-7a57-4026-b433-1bcc651964ab admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.652666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.653833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.654121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.654396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] PATH_INFO: `/v3/projects/332cc20ccbb94bd8bd0808f2d5dbc924/users/7e6e3d2b3ffd4d40bec9864628f5c337/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.656483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332cc20ccbb94bd8bd0808f2d5dbc924, user_id=7e6e3d2b3ffd4d40bec9864628f5c337, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.659321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.674739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1098/2246] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:46 2022] PUT /identity/v3/projects/332cc20ccbb94bd8bd0808f2d5dbc924/users/7e6e3d2b3ffd4d40bec9864628f5c337/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:46.686562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.686927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.687205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.717446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] MFA Rules not processed for user `7e6e3d2b3ffd4d40bec9864628f5c337`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:46.718806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:46.754757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:46.799037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1149/2247] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:46.810230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:46.811985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:46.880957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495e86-55a4-4c28-bfd3-2f3473a05970 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:46.884684 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74cafa-aae0-4dc3-b2d5-61fddf6af1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:46.885321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74cafa-aae0-4dc3-b2d5-61fddf6af1ec service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:46.885607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74cafa-aae0-4dc3-b2d5-61fddf6af1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:46.885887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74cafa-aae0-4dc3-b2d5-61fddf6af1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:46.952472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74cafa-aae0-4dc3-b2d5-61fddf6af1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:46.954146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74cafa-aae0-4dc3-b2d5-61fddf6af1ec service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:46.964203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1099/2248] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:54.523083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:54.525112 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:54.611105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece485f-e3cb-4810-b343-26a86d4f2a2e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:54.617489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:54.620607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:54.621100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:54.621398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] PATH_INFO: `/v3/users/083673f20b0e45808e542719f7f94028` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:54.622852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=083673f20b0e45808e542719f7f94028)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:54.625172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:54.698921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083673f20b0e45808e542719f7f94028'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:54.704946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083673f20b0e45808e542719f7f94028'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:54.705698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083673f20b0e45808e542719f7f94028'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:54.706314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083673f20b0e45808e542719f7f94028'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:54.715141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083673f20b0e45808e542719f7f94028'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:54.730252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1150/2249] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:54 2022] DELETE /identity/v3/users/083673f20b0e45808e542719f7f94028 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:54.734935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:54.735403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:54.735548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:54.753892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:54.755283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:54.787737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:54.842110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1100/2250] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:54.852750 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:54.853715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:54.889021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:54.890655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:54.951891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368ded0-906a-44f5-9290-db0e3d74c99e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:54.965483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:54.966148 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:54.966426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:54.966745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:54.973778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:54.977963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:54.979917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1c32d-2510-4ff2-aaeb-b361790fc250 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:54.981715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:54.984618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a0029-0754-4f84-b994-e7d0ca288e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:54.985286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0029-0754-4f84-b994-e7d0ca288e3a service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:54.985569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0029-0754-4f84-b994-e7d0ca288e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:54.985848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0029-0754-4f84-b994-e7d0ca288e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:54.987880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-105a0029-0754-4f84-b994-e7d0ca288e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:54.999204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1151/2251] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:55.102815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a0029-0754-4f84-b994-e7d0ca288e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:55.104603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a0029-0754-4f84-b994-e7d0ca288e3a service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:55.123175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1101/2252] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:23:55.428223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:55.429769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:55.451393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17d70-819e-4737-a7d3-96453f0fea54 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:55.467235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:55.469485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:55.470173 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:55.470666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] PATH_INFO: `/v3/projects/47f188ba229a49749df2f89f8cb2d24c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:55.472852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f188ba229a49749df2f89f8cb2d24c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:55.479031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:55.537038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f188ba229a49749df2f89f8cb2d24c', 'request_id': 'req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:55.546082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f188ba229a49749df2f89f8cb2d24c', 'request_id': 'req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:55.554022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f188ba229a49749df2f89f8cb2d24c', 'request_id': 'req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:55.569097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] The token cache is being invalidate because project 47f188ba229a49749df2f89f8cb2d24c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:55.569405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:55.570099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e0ef7811-3e6a-4ae7-b93e-20b5ba15b608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:55.571935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1152/2253] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:55 2022] DELETE /identity/v3/projects/47f188ba229a49749df2f89f8cb2d24c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:56.674006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80403341-b970-41ce-8f11-00c72170b7b8 None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:56.674553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80403341-b970-41ce-8f11-00c72170b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:56.674716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80403341-b970-41ce-8f11-00c72170b7b8 None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:56.677802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1102/2254] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:23:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:23:56.684196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:56.684716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:56.684974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:56.705203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] MFA Rules not processed for user `888cdfc6fbf94f02bd671b67280d767f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:56.706433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:56.785968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1153/2255] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:56.799232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80403341-b970-41ce-8f11-00c72170b7b8 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:56.800972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-80403341-b970-41ce-8f11-00c72170b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:56.829497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80403341-b970-41ce-8f11-00c72170b7b8 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:56.836674 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:56.837577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:56.837919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:56.838254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:56.848049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:56.849947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:56.861568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1103/2256] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:23:57.416697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:57.418158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:57.490883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc1aa0-a0e6-429d-8f78-330fdf2a4702 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:57.498287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:57.499214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:57.499501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:57.499783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] PATH_INFO: `/v3/users/5286d127b7e449f4b05a01df70dee291` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:57.501041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5286d127b7e449f4b05a01df70dee291)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:57.503033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:57.521082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:57.583916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5286d127b7e449f4b05a01df70dee291'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.607239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5286d127b7e449f4b05a01df70dee291'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.608092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5286d127b7e449f4b05a01df70dee291'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.608835 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5286d127b7e449f4b05a01df70dee291'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.617123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5286d127b7e449f4b05a01df70dee291'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.636106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1154/2257] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:57 2022] DELETE /identity/v3/users/5286d127b7e449f4b05a01df70dee291 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:57.817313 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:57.839637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf9f0-81a1-47e0-b160-8490f4b5b183 service placement] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:57.903418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:57.904286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:57.904566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:57.904839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] PATH_INFO: `/v3/projects/66046d779eaf498eb5a7d0049693501d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:57.906070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66046d779eaf498eb5a7d0049693501d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:57.908021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:57.919169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:57.956908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66046d779eaf498eb5a7d0049693501d', 'request_id': 'req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.965074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66046d779eaf498eb5a7d0049693501d', 'request_id': 'req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.971581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66046d779eaf498eb5a7d0049693501d', 'request_id': 'req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.982143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] The token cache is being invalidate because project 66046d779eaf498eb5a7d0049693501d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:57.982429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.983104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:57.984647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1104/2258] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:57 2022] DELETE /identity/v3/projects/66046d779eaf498eb5a7d0049693501d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:57.988545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:57.990538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:58.004161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8ab1-15dc-41bb-bdde-bb5e0e6ff7f0 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.062281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:58.063186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.063466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.063736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] PATH_INFO: `/v3/users/a2aff07d6e434e288038ad232f0281e1` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.064945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2aff07d6e434e288038ad232f0281e1)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:58.066957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:58.119130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2aff07d6e434e288038ad232f0281e1'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.131188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2aff07d6e434e288038ad232f0281e1'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.131955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2aff07d6e434e288038ad232f0281e1'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.132615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2aff07d6e434e288038ad232f0281e1'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.140690 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d40d9a69-dd80-40ec-bedf-c26a26bb6c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2aff07d6e434e288038ad232f0281e1'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.155252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1155/2259] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:23:57 2022] DELETE /identity/v3/users/a2aff07d6e434e288038ad232f0281e1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:58.369346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:58.370860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:58.385724 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e5a73-7ab0-46e0-9539-3ed05fef9a5d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.446254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:58.447159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.447443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.447975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] PATH_INFO: `/v3/projects/070d69c61c534edab9dd97a3dcfb7c00` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.449213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070d69c61c534edab9dd97a3dcfb7c00)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:58.451175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:58.501092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070d69c61c534edab9dd97a3dcfb7c00', 'request_id': 'req-40d36290-e8df-4dae-9416-f1c17394b522'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.514410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070d69c61c534edab9dd97a3dcfb7c00', 'request_id': 'req-40d36290-e8df-4dae-9416-f1c17394b522'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.521397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070d69c61c534edab9dd97a3dcfb7c00', 'request_id': 'req-40d36290-e8df-4dae-9416-f1c17394b522'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.532248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] The token cache is being invalidate because project 070d69c61c534edab9dd97a3dcfb7c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:23:58.532537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.533229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-40d36290-e8df-4dae-9416-f1c17394b522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:23:58.534841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1105/2260] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:23:58 2022] DELETE /identity/v3/projects/070d69c61c534edab9dd97a3dcfb7c00 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:58.541229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a98f-ae36-474b-9c3a-00b9335b5b41 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.541543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a98f-ae36-474b-9c3a-00b9335b5b41 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.541829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7a98f-ae36-474b-9c3a-00b9335b5b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.560643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9da7a98f-ae36-474b-9c3a-00b9335b5b41 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:58.561873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9da7a98f-ae36-474b-9c3a-00b9335b5b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:58.567409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:58.631059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1156/2261] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:58.638827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb5b4f-921d-4603-93fe-a773c36b42cc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.639121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb5b4f-921d-4603-93fe-a773c36b42cc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.639401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb5b4f-921d-4603-93fe-a773c36b42cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.661235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-20fb5b4f-921d-4603-93fe-a773c36b42cc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:58.662495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-20fb5b4f-921d-4603-93fe-a773c36b42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:58.672996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1106/2262] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:23:58.678654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a98f-ae36-474b-9c3a-00b9335b5b41 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:58.692010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7a98f-ae36-474b-9c3a-00b9335b5b41 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.697325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:58.698245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.698521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.698984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.699783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:23:58.700165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:58.701924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:58.719018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1157/2263] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:23:58.719851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb5b4f-921d-4603-93fe-a773c36b42cc None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:58.735504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb5b4f-921d-4603-93fe-a773c36b42cc None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.740547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:58.741531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.741885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.743782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.743956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:58.745797 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:58.768365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:58.779188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1107/2264] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:58 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:23:58.780389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:58.793825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c378a-d1d9-4390-a6ba-fe4abc75ebc4 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.867055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:58.867683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.867965 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.868244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.868945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:58.870955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:58.893678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1158/2265] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:58 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:58.901287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:58.915883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36682a-b6ce-4f31-8e83-04814b70df8f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.921515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:58.922333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.922655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.923004 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.923842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:58.925573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:58.937480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1108/2266] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:58.942026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:58.953384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254003ff-e812-4c92-9095-387d60b6c530 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.963813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b65e5-94ca-4d19-92ad-81299b74bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:58.964451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b65e5-94ca-4d19-92ad-81299b74bf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:58.964805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b65e5-94ca-4d19-92ad-81299b74bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:58.965150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b65e5-94ca-4d19-92ad-81299b74bf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:58.965954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b65e5-94ca-4d19-92ad-81299b74bf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:58.967767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b65e5-94ca-4d19-92ad-81299b74bf53 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:58.979178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1159/2267] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:58.983996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:58.994859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c1fc-3a1b-4d46-aaa0-32915ce12882 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:58.999742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.000677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.000966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.001248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] PATH_INFO: `/v3/projects/8847d7193b7645f2bc0108a958ae96d9/users/f98f0ad36cf640dfa2db47b0c5780a2c/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.029750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8847d7193b7645f2bc0108a958ae96d9, user_id=f98f0ad36cf640dfa2db47b0c5780a2c, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.035178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.061861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1109/2268] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:58 2022] PUT /identity/v3/projects/8847d7193b7645f2bc0108a958ae96d9/users/f98f0ad36cf640dfa2db47b0c5780a2c/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:59.075498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b223b-4f41-4beb-aae5-ebf7d4251a1b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.076782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b223b-4f41-4beb-aae5-ebf7d4251a1b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.077225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b223b-4f41-4beb-aae5-ebf7d4251a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.116122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c58b223b-4f41-4beb-aae5-ebf7d4251a1b None None] MFA Rules not processed for user `f98f0ad36cf640dfa2db47b0c5780a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:59.117866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c58b223b-4f41-4beb-aae5-ebf7d4251a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:59.187706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1160/2269] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:59.192509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.260785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26b95-e6ff-444d-a7dc-17b9022ae53b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:59.265512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.266168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.266449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.266746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.267438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.269355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.297962 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1110/2270] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:59 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:59.302090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b223b-4f41-4beb-aae5-ebf7d4251a1b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.313647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b223b-4f41-4beb-aae5-ebf7d4251a1b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:59.317222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:59.387444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.388640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.389166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.389923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.391736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.395969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.422305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1161/2271] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:59 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:59.426544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.438051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfc3c7-4076-4c4f-95fb-1a32fff4e91c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:59.443286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.444019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.444356 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.444639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.446029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.448050 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.460973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1111/2272] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:59.465569 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.476703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed1b18-41fd-422c-b876-6ccc8fba081d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:59.481354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d83d1b-4a3a-4c97-8773-a565796cc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.482049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83d1b-4a3a-4c97-8773-a565796cc608 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.482328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83d1b-4a3a-4c97-8773-a565796cc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.482610 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83d1b-4a3a-4c97-8773-a565796cc608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.483392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d83d1b-4a3a-4c97-8773-a565796cc608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.485036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d83d1b-4a3a-4c97-8773-a565796cc608 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.499592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1162/2273] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:23:59.504027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.515349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941586bd-d18e-4da8-abc6-910a70ff9de7 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:59.520011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.520893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.521182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.521451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] PATH_INFO: `/v3/projects/e695f90cad3b4a75bb771bbf23f3bfe4/users/1ff365147b15435ea221f066c73f6129/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.537168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e695f90cad3b4a75bb771bbf23f3bfe4, user_id=1ff365147b15435ea221f066c73f6129, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.539925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.553257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1112/2274] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:23:59 2022] PUT /identity/v3/projects/e695f90cad3b4a75bb771bbf23f3bfe4/users/1ff365147b15435ea221f066c73f6129/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:23:59.624702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad3017-0506-4b1f-bc90-f4c3bc7c06d5 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.625006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad3017-0506-4b1f-bc90-f4c3bc7c06d5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.625312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad3017-0506-4b1f-bc90-f4c3bc7c06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.653632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-22ad3017-0506-4b1f-bc90-f4c3bc7c06d5 None None] MFA Rules not processed for user `1ff365147b15435ea221f066c73f6129`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:23:59.654813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-22ad3017-0506-4b1f-bc90-f4c3bc7c06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:23:59.730157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1163/2275] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:23:59.735222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.810824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfac77e-2ed5-495b-8e7f-12d9f6d7f812 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:59.818856 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.819617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.819971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.820353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.821645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.823890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.848699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:23:59.858419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1113/2276] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:23:59 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:59.862793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad3017-0506-4b1f-bc90-f4c3bc7c06d5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.880479 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad3017-0506-4b1f-bc90-f4c3bc7c06d5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:23:59.952702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:23:59.954563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:23:59.954563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:23:59.954563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:23:59.955160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:23:59.957224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:23:59.984122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1164/2277] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:23:59 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:23:59.985941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:23:59.999829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4a53-bd29-4b6f-aaee-3296a413b425 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:00.009074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:00.010118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:00.010623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:00.011091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:00.012409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:00.014649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:00.030516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1114/2278] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:00.035845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:00.051324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:00.057655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542188-9f2e-42cd-8864-68209eef62ed admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:00.064191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:00.065713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:00.066007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:00.066291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] PATH_INFO: `/v3/projects/c8832aa970d74984ba98bc61e09cb0be/users/59f874fc3f5544f1a23e151b0bbbb671/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:00.085506 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8832aa970d74984ba98bc61e09cb0be, user_id=59f874fc3f5544f1a23e151b0bbbb671, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:00.088550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:00.109639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1165/2279] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:24:00 2022] PUT /identity/v3/projects/c8832aa970d74984ba98bc61e09cb0be/users/59f874fc3f5544f1a23e151b0bbbb671/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:00.114295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:00.132003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19f0e-0e0a-4bfa-b01e-dffaf1d72739 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:00.192893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc3c2-82ac-4d51-8bf7-f410cc37887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:00.193663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc3c2-82ac-4d51-8bf7-f410cc37887f admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:00.194262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc3c2-82ac-4d51-8bf7-f410cc37887f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:00.194549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc3c2-82ac-4d51-8bf7-f410cc37887f admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:00.195324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc3c2-82ac-4d51-8bf7-f410cc37887f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:00.196957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc3c2-82ac-4d51-8bf7-f410cc37887f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:00.226300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1115/2280] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:00.231599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:00.250481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ede0-0de9-4b35-add5-e3af30450474 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:00.263480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:00.264525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:00.264911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:00.265458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] PATH_INFO: `/v3/projects/c8832aa970d74984ba98bc61e09cb0be/users/59f874fc3f5544f1a23e151b0bbbb671/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:00.268192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8832aa970d74984ba98bc61e09cb0be, user_id=59f874fc3f5544f1a23e151b0bbbb671, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:00.271304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:00.294987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1166/2281] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:24:00 2022] PUT /identity/v3/projects/c8832aa970d74984ba98bc61e09cb0be/users/59f874fc3f5544f1a23e151b0bbbb671/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:00.305911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:00.306494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:00.307108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:00.366048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] MFA Rules not processed for user `59f874fc3f5544f1a23e151b0bbbb671`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:00.367442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:00.450787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1116/2282] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:00.460808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:00.463435 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:00.534544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05c5cc-3b65-4f33-b78c-5faa8a9811e1 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:00.538706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:00.539914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:00.540197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:00.540473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:00.613387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:00.615187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:00.629424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1167/2283] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:02.171531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:02.173134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:02.187243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d216052-1147-48ef-a028-31e864cab6b7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:02.191232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:02.191914 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:02.192195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:02.192472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:02.264771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:02.266241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:02.277533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1117/2284] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:03.358439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:03.368655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77840a44-6935-451f-9c3d-121a498d84fc service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:03.372456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75618bc-69e1-4a02-8f01-b6182510cab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:03.373106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75618bc-69e1-4a02-8f01-b6182510cab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:03.373391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75618bc-69e1-4a02-8f01-b6182510cab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:03.373672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75618bc-69e1-4a02-8f01-b6182510cab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:03.383394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75618bc-69e1-4a02-8f01-b6182510cab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:03.384791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75618bc-69e1-4a02-8f01-b6182510cab8 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:03.395101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1168/2285] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:12.273424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:12.718522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:12.814293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab578f-c072-47be-8b38-f8ac3b046169 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:12.819779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:12.820704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:12.821031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:12.822405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] PATH_INFO: `/v3/users/f98f0ad36cf640dfa2db47b0c5780a2c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:12.823912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98f0ad36cf640dfa2db47b0c5780a2c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:12.827306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:12.889524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98f0ad36cf640dfa2db47b0c5780a2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:12.916783 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98f0ad36cf640dfa2db47b0c5780a2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:12.917704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98f0ad36cf640dfa2db47b0c5780a2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:12.918341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98f0ad36cf640dfa2db47b0c5780a2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:12.929645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98f0ad36cf640dfa2db47b0c5780a2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:12.944413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1118/2286] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:24:12 2022] DELETE /identity/v3/users/f98f0ad36cf640dfa2db47b0c5780a2c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:12.950120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:12.950578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:12.950781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:12.970997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:12.972227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:13.052555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1169/2287] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:13.064808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:13.066309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:13.164662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97cd15-0908-414d-8417-90189762b6bf admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:13.169486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:13.170318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:13.171080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:13.171080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:13.187049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:13.188794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:13.205326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1119/2288] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:13.787122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:13.789311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:13.801762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5b85-8aa4-45c9-a33b-f4d712b16760 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:13.807553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:13.808784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:13.808784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:13.809017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] PATH_INFO: `/v3/projects/8847d7193b7645f2bc0108a958ae96d9` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:13.810299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8847d7193b7645f2bc0108a958ae96d9)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:13.812393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:13.815357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:13.887243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8847d7193b7645f2bc0108a958ae96d9', 'request_id': 'req-4e675f21-c1f2-45dc-b048-2a9a24192c25'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:13.897987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8847d7193b7645f2bc0108a958ae96d9', 'request_id': 'req-4e675f21-c1f2-45dc-b048-2a9a24192c25'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:13.906527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8847d7193b7645f2bc0108a958ae96d9', 'request_id': 'req-4e675f21-c1f2-45dc-b048-2a9a24192c25'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:13.923118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] The token cache is being invalidate because project 8847d7193b7645f2bc0108a958ae96d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:24:13.923503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:13.924602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:13.926127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1170/2289] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:24:13 2022] DELETE /identity/v3/projects/8847d7193b7645f2bc0108a958ae96d9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:13.930293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:13.943084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89426-5aec-437a-8f62-ab1f647236f6 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:13.978459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:14.033151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:14.034121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:14.034499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:14.034809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] PATH_INFO: `/v3/users/1ff365147b15435ea221f066c73f6129` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:14.036034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff365147b15435ea221f066c73f6129)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:14.038010 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:14.097096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff365147b15435ea221f066c73f6129'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.111387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff365147b15435ea221f066c73f6129'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.112205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff365147b15435ea221f066c73f6129'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.112902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff365147b15435ea221f066c73f6129'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.122309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a9d40bc6-45cb-44e1-8a3d-8fffb26605a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff365147b15435ea221f066c73f6129'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.136272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1120/2290] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:24:13 2022] DELETE /identity/v3/users/1ff365147b15435ea221f066c73f6129 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:14.437376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:14.439018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:14.463019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e675f21-c1f2-45dc-b048-2a9a24192c25 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:14.557408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:14.558006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:14.558433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:14.579604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:14.580541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:14.580830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:14.581108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] PATH_INFO: `/v3/projects/e695f90cad3b4a75bb771bbf23f3bfe4` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:14.581349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] MFA Rules not processed for user `ecf6ed97c0eb4db68cf951044ce9ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:14.582339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e695f90cad3b4a75bb771bbf23f3bfe4)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:14.582579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:14.584316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:14.645845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e695f90cad3b4a75bb771bbf23f3bfe4', 'request_id': 'req-433ee806-f655-47e6-b920-7d5ef1761aba'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.658923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e695f90cad3b4a75bb771bbf23f3bfe4', 'request_id': 'req-433ee806-f655-47e6-b920-7d5ef1761aba'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.667099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e695f90cad3b4a75bb771bbf23f3bfe4', 'request_id': 'req-433ee806-f655-47e6-b920-7d5ef1761aba'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.670851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1121/2291] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:24:14.685482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] The token cache is being invalidate because project e695f90cad3b4a75bb771bbf23f3bfe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:24:14.685955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.686633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.688440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1171/2292] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:24:14 2022] DELETE /identity/v3/projects/e695f90cad3b4a75bb771bbf23f3bfe4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:14.693037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:14.694491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:14.710557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706f9f2-6ae7-4e08-ae17-348cc7eb90dd None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:14.781687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:14.795493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:14.796959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:14.797275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:14.797577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] PATH_INFO: `/v3/users/59f874fc3f5544f1a23e151b0bbbb671` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:14.798995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f874fc3f5544f1a23e151b0bbbb671)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:14.801129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:14.870438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f874fc3f5544f1a23e151b0bbbb671'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.888879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f874fc3f5544f1a23e151b0bbbb671'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.889811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f874fc3f5544f1a23e151b0bbbb671'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.891709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f874fc3f5544f1a23e151b0bbbb671'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.904664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-146545c2-1cb7-44fc-95f5-fc1a4e7ae1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f874fc3f5544f1a23e151b0bbbb671'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:14.929792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1122/2293] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:24:14 2022] DELETE /identity/v3/users/59f874fc3f5544f1a23e151b0bbbb671 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:15.341045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:15.342635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:15.381370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:15.464032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ee806-f655-47e6-b920-7d5ef1761aba admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:15.551644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:15.552593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:15.552968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:15.553319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] PATH_INFO: `/v3/projects/c8832aa970d74984ba98bc61e09cb0be` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:15.554743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8832aa970d74984ba98bc61e09cb0be)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:15.556820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:15.613716 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8832aa970d74984ba98bc61e09cb0be', 'request_id': 'req-17ed1dc4-2159-4560-8ab7-d87f84db7204'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:15.623829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8832aa970d74984ba98bc61e09cb0be', 'request_id': 'req-17ed1dc4-2159-4560-8ab7-d87f84db7204'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:15.634132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8832aa970d74984ba98bc61e09cb0be', 'request_id': 'req-17ed1dc4-2159-4560-8ab7-d87f84db7204'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:15.653883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] The token cache is being invalidate because project c8832aa970d74984ba98bc61e09cb0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:24:15.654221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:15.654872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-17ed1dc4-2159-4560-8ab7-d87f84db7204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:15.659587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1172/2294] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:24:15 2022] DELETE /identity/v3/projects/c8832aa970d74984ba98bc61e09cb0be => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:24:15.661337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83538c77-e521-4ccc-a201-596e6b47c1c0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:15.661812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83538c77-e521-4ccc-a201-596e6b47c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:15.661918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83538c77-e521-4ccc-a201-596e6b47c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:15.748483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-83538c77-e521-4ccc-a201-596e6b47c1c0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:15.749945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-83538c77-e521-4ccc-a201-596e6b47c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:15.826916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1123/2295] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:15.836348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2424f-6b9f-42f4-93b4-0cb551fced7a None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:15.836634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2424f-6b9f-42f4-93b4-0cb551fced7a None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:15.837552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2424f-6b9f-42f4-93b4-0cb551fced7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:15.861184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1bc2424f-6b9f-42f4-93b4-0cb551fced7a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:15.862423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1bc2424f-6b9f-42f4-93b4-0cb551fced7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:15.871287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1173/2296] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:24:15.875776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83538c77-e521-4ccc-a201-596e6b47c1c0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:15.886959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83538c77-e521-4ccc-a201-596e6b47c1c0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:15.891672 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:15.892335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:15.892615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:15.892891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:15.893617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:24:15.893918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:15.895566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:15.908543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1124/2297] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:24:15.912960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2424f-6b9f-42f4-93b4-0cb551fced7a None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:15.922846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2424f-6b9f-42f4-93b4-0cb551fced7a None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:15.927929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:15.928589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:15.928932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:15.929199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:15.929935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:15.931967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:15.958607 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1174/2298] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:24:15 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:24:15.963493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:15.974348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fe518-6e1e-4bfa-9c0d-ee873653efd7 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:16.005917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:16.041155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:16.041844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:16.042131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:16.042413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:16.043162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:16.045189 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:16.067768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1125/2299] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:24:15 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:24:16.072381 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:16.083778 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeb4fe-44e0-4dc4-b348-8c3820b65fdc admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:16.088745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:16.089415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:16.089704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:16.089984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:16.090762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:16.092383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:16.106486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1175/2300] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:16.111094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:16.124152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2951c-b462-4cda-a15a-ec2d58ea830e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:16.130399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fcca7-6e50-4a52-85f1-dd16f9242a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:16.131246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fcca7-6e50-4a52-85f1-dd16f9242a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:16.131628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fcca7-6e50-4a52-85f1-dd16f9242a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:16.132005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fcca7-6e50-4a52-85f1-dd16f9242a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:16.132859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fcca7-6e50-4a52-85f1-dd16f9242a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:16.135570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fcca7-6e50-4a52-85f1-dd16f9242a1b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:16.146243 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1126/2301] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:16.150907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:16.160928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aff78-7e2b-4122-a588-c4dec79e4cb5 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:16.168436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:16.169328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:16.169612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:16.169887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] PATH_INFO: `/v3/projects/3ffbc2657f284297918361ecafc552e9/users/c50333fdd448432e8abe5174996cc819/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:16.181639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:16.190248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffbc2657f284297918361ecafc552e9, user_id=c50333fdd448432e8abe5174996cc819, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:16.193198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:16.209161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1176/2302] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:24:16 2022] PUT /identity/v3/projects/3ffbc2657f284297918361ecafc552e9/users/c50333fdd448432e8abe5174996cc819/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:16.219639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:16.219925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:16.220204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:16.248124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] MFA Rules not processed for user `c50333fdd448432e8abe5174996cc819`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:16.249260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:16.320759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1127/2303] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:16.332736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:16.334493 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:16.416458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332c69-6d24-4813-95d8-2a3ae29cb4b8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:16.420293 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:16.420952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:16.421239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:16.421516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:16.431337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:16.432784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:16.442349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1177/2304] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:19.004387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:19.005975 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:19.126385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec431c-632b-4133-89ca-e882da6c92ce None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:19.130830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b897e-531b-4cdd-85b3-ad0155588998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:19.131784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b897e-531b-4cdd-85b3-ad0155588998 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:19.132256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b897e-531b-4cdd-85b3-ad0155588998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:19.132846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b897e-531b-4cdd-85b3-ad0155588998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:19.136255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c61b897e-531b-4cdd-85b3-ad0155588998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:19.173630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:19.219780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b897e-531b-4cdd-85b3-ad0155588998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:19.221340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b897e-531b-4cdd-85b3-ad0155588998 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:19.233549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1128/2305] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:21.565624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:21.567427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:21.651821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b678033-ff98-4ea5-a21f-9f98303c71a5 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:21.651821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:21.651821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:21.651821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:21.652147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] PATH_INFO: `/v3/users/9affaba21a6849bc8a836438426d0617` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:21.653367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9affaba21a6849bc8a836438426d0617)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:21.655369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:21.712275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9affaba21a6849bc8a836438426d0617'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:21.733474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9affaba21a6849bc8a836438426d0617'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:21.734529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9affaba21a6849bc8a836438426d0617'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:21.735530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9affaba21a6849bc8a836438426d0617'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:21.748603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9affaba21a6849bc8a836438426d0617'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:21.753543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:21.776012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1178/2306] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:24:21 2022] DELETE /identity/v3/users/9affaba21a6849bc8a836438426d0617 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:21.780430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:21.781280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:21.781758 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:21.813492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:21.814789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:21.918078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1129/2307] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:21.934195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:21.936227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:22.033910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46053119-8c08-496d-8488-76ef4a47bafa admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:22.043542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:22.045952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:22.047102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:22.048136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:22.064276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:22.066620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:22.089542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1179/2308] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:22.851422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:22.852925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:22.868433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ec09-57fc-4b3a-8d62-75f1e903efb7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:22.874835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:22.875837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:22.876338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:22.876847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] PATH_INFO: `/v3/projects/40163cd183194725a7f50630a4d2f701` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:22.878869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40163cd183194725a7f50630a4d2f701)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:22.881472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:22.942956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40163cd183194725a7f50630a4d2f701', 'request_id': 'req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:22.955023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40163cd183194725a7f50630a4d2f701', 'request_id': 'req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:22.967381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40163cd183194725a7f50630a4d2f701', 'request_id': 'req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:22.984031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] The token cache is being invalidate because project 40163cd183194725a7f50630a4d2f701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:24:22.984608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:22.985435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3a3a36d0-9ad7-4b22-82f0-2f8e377e6d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:22.987287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1130/2309] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:24:22 2022] DELETE /identity/v3/projects/40163cd183194725a7f50630a4d2f701 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:22.991718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:23.003570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d369b-1653-4e7f-bdab-40f24e91325a service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:23.079901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:23.080876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:23.081447 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:23.081946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] PATH_INFO: `/v3/users/7e6e3d2b3ffd4d40bec9864628f5c337` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:23.084563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6e3d2b3ffd4d40bec9864628f5c337)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:23.087884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:23.149740 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722fcb5-432e-453b-8da0-33e3bc1211cd None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:23.150218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722fcb5-432e-453b-8da0-33e3bc1211cd None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:23.150573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722fcb5-432e-453b-8da0-33e3bc1211cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:23.169585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6e3d2b3ffd4d40bec9864628f5c337'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.171489 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c722fcb5-432e-453b-8da0-33e3bc1211cd None None] MFA Rules not processed for user `e7f3274a762a4e1c8ae1474ffcbe912d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:23.172739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c722fcb5-432e-453b-8da0-33e3bc1211cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:23.187470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6e3d2b3ffd4d40bec9864628f5c337'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.188919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6e3d2b3ffd4d40bec9864628f5c337'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.189933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6e3d2b3ffd4d40bec9864628f5c337'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.203481 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6e3d2b3ffd4d40bec9864628f5c337'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.220898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1180/2310] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:24:22 2022] DELETE /identity/v3/users/7e6e3d2b3ffd4d40bec9864628f5c337 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:23.240656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:23.255934 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1131/2311] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:23.608538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:23.610234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:23.634380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:23.721633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820b05b-5ccc-45d1-ac8a-6a46dbad9279 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:23.727175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:23.728832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:23.729241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:23.729373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] PATH_INFO: `/v3/projects/332cc20ccbb94bd8bd0808f2d5dbc924` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:23.730635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332cc20ccbb94bd8bd0808f2d5dbc924)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:23.732663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:23.804230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332cc20ccbb94bd8bd0808f2d5dbc924', 'request_id': 'req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.824062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332cc20ccbb94bd8bd0808f2d5dbc924', 'request_id': 'req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.835220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332cc20ccbb94bd8bd0808f2d5dbc924', 'request_id': 'req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.855790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] The token cache is being invalidate because project 332cc20ccbb94bd8bd0808f2d5dbc924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:24:23.856269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.857141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e5a30610-7e60-4567-9e6d-8a2ebbb96c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:23.859074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1181/2312] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:24:23 2022] DELETE /identity/v3/projects/332cc20ccbb94bd8bd0808f2d5dbc924 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:23.864112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76077aa-7047-4404-a7bf-058ffa31a95b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:23.864846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76077aa-7047-4404-a7bf-058ffa31a95b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:23.864846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76077aa-7047-4404-a7bf-058ffa31a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:23.903805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d76077aa-7047-4404-a7bf-058ffa31a95b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:23.905161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d76077aa-7047-4404-a7bf-058ffa31a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:23.979759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1132/2313] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:24:23.987866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88623b4b-c149-4130-93cc-7ab5d2a4b949 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:23.988314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88623b4b-c149-4130-93cc-7ab5d2a4b949 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:23.988720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88623b4b-c149-4130-93cc-7ab5d2a4b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.009391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-88623b4b-c149-4130-93cc-7ab5d2a4b949 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:24.010613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-88623b4b-c149-4130-93cc-7ab5d2a4b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:24.025557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1182/2314] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:24.029912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76077aa-7047-4404-a7bf-058ffa31a95b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.040118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76077aa-7047-4404-a7bf-058ffa31a95b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.045027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.045790 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.046081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.046358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.047162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:24:24.047474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.049133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.062716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1133/2315] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:24:24.067483 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88623b4b-c149-4130-93cc-7ab5d2a4b949 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.077934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88623b4b-c149-4130-93cc-7ab5d2a4b949 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.082660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.083373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.083652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.083930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.084641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.086638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.119016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1183/2316] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:24:24 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:24:24.123355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.140839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c5e03-1db4-42d5-a79c-efcb1aa8184a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.211105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.211803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.212080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.212357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.213172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.215129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.240467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1134/2317] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:24:24 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:24:24.246030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.257214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa6607-cc78-4baa-a7d9-5cb5876389cc admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.262438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.263142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.263429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.263709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.264543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.266166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.278043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1184/2318] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:24.282207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.294577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43ac5b-2a07-4859-8c4b-ccb1a86dfd39 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.299689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ff0e6-5ffc-449a-8776-c0914ef2373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.300465 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff0e6-5ffc-449a-8776-c0914ef2373b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.300752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff0e6-5ffc-449a-8776-c0914ef2373b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.301116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ff0e6-5ffc-449a-8776-c0914ef2373b admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.301824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ff0e6-5ffc-449a-8776-c0914ef2373b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.303524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ff0e6-5ffc-449a-8776-c0914ef2373b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.315544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1135/2319] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:24.319997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.330909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e10c1-99ce-4cf0-bf2c-654ff6298945 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.335867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.337516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.337872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.338222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] PATH_INFO: `/v3/projects/2e18bf3f1bf047769c37fe0099280a19/users/8986634f201945c6aa97c453234c891a/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.355491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e18bf3f1bf047769c37fe0099280a19, user_id=8986634f201945c6aa97c453234c891a, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.358061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.372896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1185/2320] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:24:24 2022] PUT /identity/v3/projects/2e18bf3f1bf047769c37fe0099280a19/users/8986634f201945c6aa97c453234c891a/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:24.386121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311374aa-e077-473b-bddb-aca3238558b0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.386528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311374aa-e077-473b-bddb-aca3238558b0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.387031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311374aa-e077-473b-bddb-aca3238558b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.427964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-311374aa-e077-473b-bddb-aca3238558b0 None None] MFA Rules not processed for user `8986634f201945c6aa97c453234c891a`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:24.429874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-311374aa-e077-473b-bddb-aca3238558b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:24.505127 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:24.535606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1136/2321] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:24.541328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.609527 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:24.643688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d7537-ab17-48eb-9d0a-6b787aaee73e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.650276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.651026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.651309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.651637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.652341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.655103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.692144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1186/2322] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:24:24 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:24:24.699630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311374aa-e077-473b-bddb-aca3238558b0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.710650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311374aa-e077-473b-bddb-aca3238558b0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.784405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.786506 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.786846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.787235 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.788285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.790766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.822215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1137/2323] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:24:24 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:24:24.827348 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.851331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0703-1a72-4d18-a239-41895dba4cb6 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.857194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.858001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.858428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.858865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.859832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.861807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.875427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1187/2324] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:24.880055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.891140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef01bd3-b0b7-485c-9fce-324ed28ebe7a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:24.896433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:24.897418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:24.897772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:24.898142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] PATH_INFO: `/v3/projects/93b3e434ffe04ce2ab82274bba50e84a/users/be5a67f90468460b9278429c5b55ff8e/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:24.916137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b3e434ffe04ce2ab82274bba50e84a, user_id=be5a67f90468460b9278429c5b55ff8e, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:24.919068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:24.936208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1138/2325] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:24:24 2022] PUT /identity/v3/projects/93b3e434ffe04ce2ab82274bba50e84a/users/be5a67f90468460b9278429c5b55ff8e/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:24.940606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:24.958176 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7e8b8-bec3-4642-abae-d1159566a45e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:25.028956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2afe16-054d-42c4-a4ac-23c9f0893afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:25.029849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2afe16-054d-42c4-a4ac-23c9f0893afe admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:25.029934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2afe16-054d-42c4-a4ac-23c9f0893afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:25.030241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2afe16-054d-42c4-a4ac-23c9f0893afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:25.031185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2afe16-054d-42c4-a4ac-23c9f0893afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:25.032705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2afe16-054d-42c4-a4ac-23c9f0893afe admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:25.047979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1188/2326] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:25.052947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:25.073681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0986d-34d3-4102-9f4a-97a513a0706e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:25.080167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:25.081067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:25.081349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:25.081621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] PATH_INFO: `/v3/projects/93b3e434ffe04ce2ab82274bba50e84a/users/be5a67f90468460b9278429c5b55ff8e/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:25.083696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b3e434ffe04ce2ab82274bba50e84a, user_id=be5a67f90468460b9278429c5b55ff8e, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:25.086443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:25.098993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1139/2327] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:24:25 2022] PUT /identity/v3/projects/93b3e434ffe04ce2ab82274bba50e84a/users/be5a67f90468460b9278429c5b55ff8e/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:24:25.108997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae83b-9c78-42de-90de-0f9998b850c0 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:25.109353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae83b-9c78-42de-90de-0f9998b850c0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:25.109555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aae83b-9c78-42de-90de-0f9998b850c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:25.153096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-47aae83b-9c78-42de-90de-0f9998b850c0 None None] MFA Rules not processed for user `be5a67f90468460b9278429c5b55ff8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:25.154520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-47aae83b-9c78-42de-90de-0f9998b850c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:25.279709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1189/2328] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:25.292613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:25.294661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:25.388052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b943bd9-ff40-42e9-af3f-83aa75b7ee1c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:25.394009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3887b3f-e14a-421e-9d4a-82e9f6c05186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:25.394417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887b3f-e14a-421e-9d4a-82e9f6c05186 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:25.394552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887b3f-e14a-421e-9d4a-82e9f6c05186 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:25.394861 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3887b3f-e14a-421e-9d4a-82e9f6c05186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:25.405665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3887b3f-e14a-421e-9d4a-82e9f6c05186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:25.408037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3887b3f-e14a-421e-9d4a-82e9f6c05186 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:25.426738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1140/2329] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:26.203874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae83b-9c78-42de-90de-0f9998b850c0 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:26.291117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:26.342547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aae83b-9c78-42de-90de-0f9998b850c0 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:26.349088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:26.349984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:26.350403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:26.350762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] PATH_INFO: `/v3/users/8986634f201945c6aa97c453234c891a` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:26.352001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8986634f201945c6aa97c453234c891a)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:26.355354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:26.427957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8986634f201945c6aa97c453234c891a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:26.471531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8986634f201945c6aa97c453234c891a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:26.472289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8986634f201945c6aa97c453234c891a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:26.472929 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8986634f201945c6aa97c453234c891a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:26.491699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8986634f201945c6aa97c453234c891a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:26.516492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1190/2330] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:24:26 2022] DELETE /identity/v3/users/8986634f201945c6aa97c453234c891a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:26.521064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:26.521567 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:26.521670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:26.542996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:26.544233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:26.604603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:26.638125 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1141/2331] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:26.650202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:26.651700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:26.714584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246959e-9049-408b-a9d4-f16ae575589e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:26.718172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:26.718853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:26.719134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:26.719411 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:26.730567 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:26.732063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:26.742404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1191/2332] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:27.084108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:27.085843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:27.103979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf377e3-b1b1-42a5-8aaa-ca4e6dde0146 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:27.108714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:27.109571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:27.109851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:27.110122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] PATH_INFO: `/v3/projects/2e18bf3f1bf047769c37fe0099280a19` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:27.111392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e18bf3f1bf047769c37fe0099280a19)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:27.113285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:27.164394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e18bf3f1bf047769c37fe0099280a19', 'request_id': 'req-c756f709-9b81-420b-8af3-95e0ca79ff6f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.172839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e18bf3f1bf047769c37fe0099280a19', 'request_id': 'req-c756f709-9b81-420b-8af3-95e0ca79ff6f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.179967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e18bf3f1bf047769c37fe0099280a19', 'request_id': 'req-c756f709-9b81-420b-8af3-95e0ca79ff6f'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.190602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] The token cache is being invalidate because project 2e18bf3f1bf047769c37fe0099280a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:24:27.190923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.191579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.193129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1142/2333] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:24:27 2022] DELETE /identity/v3/projects/2e18bf3f1bf047769c37fe0099280a19 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:27.197919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:27.207672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d27356-ec35-47bb-b364-8fd3a3c3ff47 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:27.267962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:27.268743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:27.269024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:27.269299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] PATH_INFO: `/v3/users/be5a67f90468460b9278429c5b55ff8e` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:27.270498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5a67f90468460b9278429c5b55ff8e)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:27.272672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:27.274950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:27.324197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5a67f90468460b9278429c5b55ff8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.336924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5a67f90468460b9278429c5b55ff8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.337651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5a67f90468460b9278429c5b55ff8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.338252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5a67f90468460b9278429c5b55ff8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.346621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-aebf8d34-3816-45d8-9983-3e1bfb67721c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5a67f90468460b9278429c5b55ff8e'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.367427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1192/2334] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:24:27 2022] DELETE /identity/v3/users/be5a67f90468460b9278429c5b55ff8e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:27.837393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:27.838904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:27.857277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756f709-9b81-420b-8af3-95e0ca79ff6f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:27.936515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:27.937262 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:27.937544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:27.937815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] PATH_INFO: `/v3/projects/93b3e434ffe04ce2ab82274bba50e84a` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:27.939076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b3e434ffe04ce2ab82274bba50e84a)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:27.941008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:27.990564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b3e434ffe04ce2ab82274bba50e84a', 'request_id': 'req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:27.998242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b3e434ffe04ce2ab82274bba50e84a', 'request_id': 'req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:28.004901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b3e434ffe04ce2ab82274bba50e84a', 'request_id': 'req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:28.009770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:28.019378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] The token cache is being invalidate because project 93b3e434ffe04ce2ab82274bba50e84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:24:28.020076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:28.021136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6e1e0d55-1d5c-43bf-b266-09373d5ac90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:24:28.023670 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1143/2335] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:24:27 2022] DELETE /identity/v3/projects/93b3e434ffe04ce2ab82274bba50e84a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:28.029472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0854f-e4c2-4278-be77-5622f0644d2d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.029762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0854f-e4c2-4278-be77-5622f0644d2d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.030139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0854f-e4c2-4278-be77-5622f0644d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.050005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-83f0854f-e4c2-4278-be77-5622f0644d2d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:28.051562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-83f0854f-e4c2-4278-be77-5622f0644d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:28.113289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1193/2336] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:28.121582 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6311bc-57dc-4ee6-a683-795a456f28ef None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.121869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6311bc-57dc-4ee6-a683-795a456f28ef None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.122146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6311bc-57dc-4ee6-a683-795a456f28ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.141580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-fa6311bc-57dc-4ee6-a683-795a456f28ef None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:28.142844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fa6311bc-57dc-4ee6-a683-795a456f28ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:28.150838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1144/2337] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:28.155375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0854f-e4c2-4278-be77-5622f0644d2d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:28.165265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0854f-e4c2-4278-be77-5622f0644d2d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:28.169900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:28.170557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.170875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.171147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.171871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:24:28.172180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:28.173817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:28.186498 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1194/2338] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:24:28.190938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6311bc-57dc-4ee6-a683-795a456f28ef None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:28.201180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6311bc-57dc-4ee6-a683-795a456f28ef None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:28.205839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:28.206490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.206799 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.207072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.207773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:28.209848 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:28.237124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1145/2339] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:24:28 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:24:28.241296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:28.253133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6a600-2420-4f4a-bca6-8496153f9fce admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:28.314352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:28.315063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.315351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.315639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.316341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:28.318268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:28.329058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:28.341196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1195/2340] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:24:28 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:24:28.344769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:28.355286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e965d1-1138-44cd-badd-4b17901d11a5 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:28.359963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:28.360631 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.360924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.361202 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.361933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:28.363654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:28.375205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1146/2341] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:24:28.379420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:28.390476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e0ab6-ce03-49bf-a063-1987a43ba297 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:28.395286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4965d6-9ce5-4cdf-a7e1-c13df715fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:28.395957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4965d6-9ce5-4cdf-a7e1-c13df715fdea admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.396246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4965d6-9ce5-4cdf-a7e1-c13df715fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.396529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4965d6-9ce5-4cdf-a7e1-c13df715fdea admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.397258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4965d6-9ce5-4cdf-a7e1-c13df715fdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:28.399444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4965d6-9ce5-4cdf-a7e1-c13df715fdea admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:28.411065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1196/2342] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:24:28.415958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:28.426224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06a216-184d-421b-ab62-e4bdb5a34c95 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:28.431312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:28.432211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.432496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.432776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] PATH_INFO: `/v3/projects/65032e20cf98437398d8c6a29294fabf/users/437875871b3c44a2bb4b067f92e7b06c/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.449827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65032e20cf98437398d8c6a29294fabf, user_id=437875871b3c44a2bb4b067f92e7b06c, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:28.452536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:28.466425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1147/2343] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:24:28 2022] PUT /identity/v3/projects/65032e20cf98437398d8c6a29294fabf/users/437875871b3c44a2bb4b067f92e7b06c/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:24:28.471715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653b9d-54bc-4479-b2da-d518aa8383b7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.472004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653b9d-54bc-4479-b2da-d518aa8383b7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.472280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63653b9d-54bc-4479-b2da-d518aa8383b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.490204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-63653b9d-54bc-4479-b2da-d518aa8383b7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:28.491460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-63653b9d-54bc-4479-b2da-d518aa8383b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:28.552954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1197/2344] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:28.564018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:28.565788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:28.632844 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bdf8a-1910-424f-84b1-9fe0fec9cc51 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:28.637442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:28.638101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:28.638382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:28.638654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:28.650150 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:28.651880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:28.662470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1148/2345] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:29.777039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e0dc-c206-485a-9069-9587745a54bf None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:29.778093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e0dc-c206-485a-9069-9587745a54bf None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:29.778604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e0dc-c206-485a-9069-9587745a54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:29.835360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-a916e0dc-c206-485a-9069-9587745a54bf None None] MFA Rules not processed for user `437875871b3c44a2bb4b067f92e7b06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:29.837441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a916e0dc-c206-485a-9069-9587745a54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:29.961372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1198/2346] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:29.974183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:29.975786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:30.127467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11fe81-e6bb-4894-9a52-52c1bfece502 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:30.133224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a56fc-335d-4d53-becd-cd1a0f7d416c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:30.134071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a56fc-335d-4d53-becd-cd1a0f7d416c service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:30.134483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a56fc-335d-4d53-becd-cd1a0f7d416c service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:30.134898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a56fc-335d-4d53-becd-cd1a0f7d416c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:30.146141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a56fc-335d-4d53-becd-cd1a0f7d416c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:30.153994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a56fc-335d-4d53-becd-cd1a0f7d416c service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:30.179563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1149/2347] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:24:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:24:36.910098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:36.910622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:36.910743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:36.929593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] MFA Rules not processed for user `437875871b3c44a2bb4b067f92e7b06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:36.931461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:36.939036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1199/2348] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:24:39.759194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3826e-b7d7-4462-b2bb-fdb0131d7fed None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:39.759927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3826e-b7d7-4462-b2bb-fdb0131d7fed None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:39.759927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3826e-b7d7-4462-b2bb-fdb0131d7fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:39.790142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-fdd3826e-b7d7-4462-b2bb-fdb0131d7fed None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:24:39.791458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fdd3826e-b7d7-4462-b2bb-fdb0131d7fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:39.816444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:39.875134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1150/2349] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:24:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:24:39.957012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:24:39.959017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:24:40.104886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226a5c-a1ec-4e71-ad98-3ab60c3395ad None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:24:40.111643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:24:40.113592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:24:40.114134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:24:40.114812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:24:40.132159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:24:40.134554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:24:40.147315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:40.156084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1200/2350] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:24:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:24:49.867113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=16 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:24:50.160429 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:25:01.692065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a2be4-f45c-46db-863e-32b8e743a845 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:01.692821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a2be4-f45c-46db-863e-32b8e743a845 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:01.692821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a2be4-f45c-46db-863e-32b8e743a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:01.713504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a28a2be4-f45c-46db-863e-32b8e743a845 None None] MFA Rules not processed for user `e062a6c5e9a94e10ac03c041e337a2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:01.714773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a28a2be4-f45c-46db-863e-32b8e743a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:01.777788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1151/2351] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:02.004973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:02.008197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:02.160380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f03d83-f1c2-4f21-89ec-b15c86fce811 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:02.183301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781436f-48f5-42e1-8a36-ccf9d3a97e15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:02.184131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781436f-48f5-42e1-8a36-ccf9d3a97e15 service placement] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:02.184521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781436f-48f5-42e1-8a36-ccf9d3a97e15 service placement] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:02.184903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781436f-48f5-42e1-8a36-ccf9d3a97e15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:02.186981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1781436f-48f5-42e1-8a36-ccf9d3a97e15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:02.201884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781436f-48f5-42e1-8a36-ccf9d3a97e15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:02.204034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781436f-48f5-42e1-8a36-ccf9d3a97e15 service placement] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:02.226414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1201/2352] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:25:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:25:05.724774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9746b69-17ac-4e88-b479-7c040cb8a9dc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:05.725380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9746b69-17ac-4e88-b479-7c040cb8a9dc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:05.725380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9746b69-17ac-4e88-b479-7c040cb8a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:05.744413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-e9746b69-17ac-4e88-b479-7c040cb8a9dc None None] MFA Rules not processed for user `437875871b3c44a2bb4b067f92e7b06c`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:05.745649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e9746b69-17ac-4e88-b479-7c040cb8a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:05.752967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1152/2353] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:06.878018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a797b9e-6072-4600-8ca2-8d75a5ace716 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:06.878934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a797b9e-6072-4600-8ca2-8d75a5ace716 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:06.879453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a797b9e-6072-4600-8ca2-8d75a5ace716 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:06.882082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1202/2354] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:25:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:25:06.889798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10cc7-08e8-4a0d-a84d-24c1edb68b8d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:06.890319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10cc7-08e8-4a0d-a84d-24c1edb68b8d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:06.890426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10cc7-08e8-4a0d-a84d-24c1edb68b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:06.950390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-22d10cc7-08e8-4a0d-a84d-24c1edb68b8d None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:06.951959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-22d10cc7-08e8-4a0d-a84d-24c1edb68b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:07.092810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1153/2355] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:07.101432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a797b9e-6072-4600-8ca2-8d75a5ace716 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:07.103795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4a797b9e-6072-4600-8ca2-8d75a5ace716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:07.255057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a797b9e-6072-4600-8ca2-8d75a5ace716 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:07.262528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0390d2b-9525-4d52-9506-3a3e1edc28fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40a1f11c5cd4b48be27dd1a0f48bdc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:07.265534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390d2b-9525-4d52-9506-3a3e1edc28fc service glance] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:07.265534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390d2b-9525-4d52-9506-3a3e1edc28fc service glance] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:07.265534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0390d2b-9525-4d52-9506-3a3e1edc28fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:07.279260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0390d2b-9525-4d52-9506-3a3e1edc28fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:07.281381 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0390d2b-9525-4d52-9506-3a3e1edc28fc service glance] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:07.300837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1203/2356] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:25:07.388345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb0c1-f2a8-4920-94fa-da52377df47c None None] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:07.389406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb0c1-f2a8-4920-94fa-da52377df47c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:07.389947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb0c1-f2a8-4920-94fa-da52377df47c None None] PATH_INFO: `/` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:07.391469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1154/2357] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:25:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 10:25:07.403310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c8a2-d252-49f7-bde1-73f80769ce22 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:07.403914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c8a2-d252-49f7-bde1-73f80769ce22 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:07.404196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c8a2-d252-49f7-bde1-73f80769ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:07.444769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-fac6c8a2-d252-49f7-bde1-73f80769ce22 None None] MFA Rules not processed for user `c11a44c395ae45fcba4e0c0fe08695c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:07.446011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-fac6c8a2-d252-49f7-bde1-73f80769ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:07.453439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1204/2358] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:07.467541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcb0c1-f2a8-4920-94fa-da52377df47c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:07.469365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-98fcb0c1-f2a8-4920-94fa-da52377df47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:07.490110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcb0c1-f2a8-4920-94fa-da52377df47c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:07.495716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa468694-edaf-4e5a-a9c4-d054de2d26cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:07.496482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa468694-edaf-4e5a-a9c4-d054de2d26cf service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:07.496831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa468694-edaf-4e5a-a9c4-d054de2d26cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:07.497182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa468694-edaf-4e5a-a9c4-d054de2d26cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:07.505682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa468694-edaf-4e5a-a9c4-d054de2d26cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:07.507321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa468694-edaf-4e5a-a9c4-d054de2d26cf service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:07.516201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1155/2359] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:25:07.612472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f3c2-f5ba-4b2e-910a-c8a737a17947 None None] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:07.612761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f3c2-f5ba-4b2e-910a-c8a737a17947 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:07.613040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f3c2-f5ba-4b2e-910a-c8a737a17947 None None] PATH_INFO: `/` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:07.614585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1205/2360] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 30 10:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 10:25:07.622434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:07.622434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:07.622434 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:07.644054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] MFA Rules not processed for user `a8c2616d20ea41f7ad4f953138f5636e`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:07.645476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:07.656538 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1156/2361] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 30 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:07.668200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f3c2-f5ba-4b2e-910a-c8a737a17947 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:07.686781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f3c2-f5ba-4b2e-910a-c8a737a17947 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:07.690604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14de27b-3dca-44de-95d3-32dee6b8b7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:07.691470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de27b-3dca-44de-95d3-32dee6b8b7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:07.691824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de27b-3dca-44de-95d3-32dee6b8b7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:07.692689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14de27b-3dca-44de-95d3-32dee6b8b7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:07.709115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14de27b-3dca-44de-95d3-32dee6b8b7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:07.709115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14de27b-3dca-44de-95d3-32dee6b8b7f4 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:07.723415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1206/2362] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:25:11.433606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:11.435182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:11.449392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7414-a583-4049-80d1-96dd3fecc97f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:11.454068 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:11.455195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:11.455475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:11.455750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] PATH_INFO: `/v3/users/c50333fdd448432e8abe5174996cc819` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:11.457030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50333fdd448432e8abe5174996cc819)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:11.459079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:11.518177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:25:11.532539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50333fdd448432e8abe5174996cc819'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:11.545642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50333fdd448432e8abe5174996cc819'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:11.546366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50333fdd448432e8abe5174996cc819'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:11.546980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50333fdd448432e8abe5174996cc819'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:11.554846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50333fdd448432e8abe5174996cc819'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:11.570083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1157/2363] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:25:11 2022] DELETE /identity/v3/users/c50333fdd448432e8abe5174996cc819 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:25:11.574644 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:11.575225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:11.575314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:11.594613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:11.595978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:11.611295 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:25:11.681828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1207/2364] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:11.691803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:11.693397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:11.821119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cf415-c9ac-4835-9389-8d88d40130be admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:11.825417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f32af-53f2-4e04-ba82-8ee4eb977611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:11.826089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f32af-53f2-4e04-ba82-8ee4eb977611 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:11.826377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f32af-53f2-4e04-ba82-8ee4eb977611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:11.826659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f32af-53f2-4e04-ba82-8ee4eb977611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:11.836785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f32af-53f2-4e04-ba82-8ee4eb977611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:11.838345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f32af-53f2-4e04-ba82-8ee4eb977611 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:11.849709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1158/2365] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:25:12.186431 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:12.188200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:12.202344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ed764-40b6-46d1-a804-2ca4f669be4d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:12.209310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:12.210503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:12.210954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:12.211444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] PATH_INFO: `/v3/projects/3ffbc2657f284297918361ecafc552e9` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:12.212955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffbc2657f284297918361ecafc552e9)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:12.215059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:12.284928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffbc2657f284297918361ecafc552e9', 'request_id': 'req-a3f07754-925f-4132-a571-f929d0499705'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:12.294753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffbc2657f284297918361ecafc552e9', 'request_id': 'req-a3f07754-925f-4132-a571-f929d0499705'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:12.304036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffbc2657f284297918361ecafc552e9', 'request_id': 'req-a3f07754-925f-4132-a571-f929d0499705'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:12.327891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] The token cache is being invalidate because project 3ffbc2657f284297918361ecafc552e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:25:12.328349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:12.329036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:12.330651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1208/2366] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:25:12 2022] DELETE /identity/v3/projects/3ffbc2657f284297918361ecafc552e9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:25:12.560193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9579a-7032-4ef0-899e-07d225f91b40 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:12.560749 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9579a-7032-4ef0-899e-07d225f91b40 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:12.560830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9579a-7032-4ef0-899e-07d225f91b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:12.617544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d4e9579a-7032-4ef0-899e-07d225f91b40 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:12.618823 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d4e9579a-7032-4ef0-899e-07d225f91b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:12.689785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1159/2367] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:25:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:12.702611 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:12.704103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:12.805131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f07754-925f-4132-a571-f929d0499705 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:12.810275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:12.810959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:12.811258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:12.811517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:12.823601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:12.825804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:12.835804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1209/2368] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:25:22.686894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=83,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:25:22.831662 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:25:38.376332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a6f53-ecee-4b1c-ad71-d45a588b9772 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:38.377023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a6f53-ecee-4b1c-ad71-d45a588b9772 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:38.377023 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a6f53-ecee-4b1c-ad71-d45a588b9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:38.398109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0a3a6f53-ecee-4b1c-ad71-d45a588b9772 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:38.398517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0a3a6f53-ecee-4b1c-ad71-d45a588b9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:38.407131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1160/2369] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:38.420575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:38.443625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc607-b217-4aee-8c99-0b3a140c4a35 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:38.457253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:38.458291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:38.459715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:38.461616 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:38.480122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:38.483528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:38.493438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1210/2370] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:25:46.762752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681abc2e-5101-4d0c-858b-fb08c20fc83d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:46.762752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681abc2e-5101-4d0c-858b-fb08c20fc83d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:46.762752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681abc2e-5101-4d0c-858b-fb08c20fc83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:46.788640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-681abc2e-5101-4d0c-858b-fb08c20fc83d None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:46.790071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-681abc2e-5101-4d0c-858b-fb08c20fc83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:46.798116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1161/2371] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 30 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:46.812012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:46.825577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513754c-c275-4258-bc86-edc83bf985e1 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:46.835878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:46.836551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:46.836834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:46.837109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:46.847047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:46.848777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:46.872422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1211/2372] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:25:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:25:56.308297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:56.308805 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:56.308908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:56.326230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:56.327430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:56.334825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1162/2373] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 30 10:25:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:56.350304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:56.360689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a07a54-6d18-40a1-8e4f-33c1c8862ba9 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:56.366302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:56.366976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:56.367259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:56.367536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:56.375441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:56.377006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:56.385319 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1212/2374] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:25:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 10:25:59.087603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:59.089230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:59.165504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf845a-659a-4f0e-be0d-5052a79848e0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:59.173918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:59.176354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:59.176354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:59.176354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] PATH_INFO: `/v3/users/437875871b3c44a2bb4b067f92e7b06c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:59.176761 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=437875871b3c44a2bb4b067f92e7b06c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:59.179041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:59.231446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437875871b3c44a2bb4b067f92e7b06c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.247471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437875871b3c44a2bb4b067f92e7b06c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.248229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437875871b3c44a2bb4b067f92e7b06c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.249049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437875871b3c44a2bb4b067f92e7b06c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.259957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-82de61b0-b5c2-4be4-9770-fa67acd93aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437875871b3c44a2bb4b067f92e7b06c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.286802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1163/2375] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:25:59 2022] DELETE /identity/v3/users/437875871b3c44a2bb4b067f92e7b06c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:25:59.570565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:59.583947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89521-29c2-433d-8306-b19b2cd711ec service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:59.646550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:59.647475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:59.647758 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:59.648029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] PATH_INFO: `/v3/projects/65032e20cf98437398d8c6a29294fabf` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:59.649249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65032e20cf98437398d8c6a29294fabf)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:59.651183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:59.704220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65032e20cf98437398d8c6a29294fabf', 'request_id': 'req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.712000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65032e20cf98437398d8c6a29294fabf', 'request_id': 'req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.718974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65032e20cf98437398d8c6a29294fabf', 'request_id': 'req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.729892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] The token cache is being invalidate because project 65032e20cf98437398d8c6a29294fabf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:25:59.730181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.730872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-cd3b1ce8-e053-468b-a77a-bdffa8c9e087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:25:59.732450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1213/2376] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:25:59 2022] DELETE /identity/v3/projects/65032e20cf98437398d8c6a29294fabf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:25:59.738228 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee82a1-c3a8-4c07-af40-e285608b4ef5 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:59.738817 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee82a1-c3a8-4c07-af40-e285608b4ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:59.739880 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee82a1-c3a8-4c07-af40-e285608b4ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:59.764786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a4ee82a1-c3a8-4c07-af40-e285608b4ef5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:59.766137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a4ee82a1-c3a8-4c07-af40-e285608b4ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:59.825063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:25:59.837178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1164/2377] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:59.846046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3b61-ce45-482b-a329-92bbf6fb20a6 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:59.846548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3b61-ce45-482b-a329-92bbf6fb20a6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:59.847103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce3b61-ce45-482b-a329-92bbf6fb20a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:59.868707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-67ce3b61-ce45-482b-a329-92bbf6fb20a6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:25:59.869976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-67ce3b61-ce45-482b-a329-92bbf6fb20a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:25:59.878321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1214/2378] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:25:59.883352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee82a1-c3a8-4c07-af40-e285608b4ef5 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:59.893360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee82a1-c3a8-4c07-af40-e285608b4ef5 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:59.898251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:59.899029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:59.899315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:59.899594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:59.900689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:25:59.900689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:59.902316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:59.916563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1165/2379] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:25:59.921057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce3b61-ce45-482b-a329-92bbf6fb20a6 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:59.934299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce3b61-ce45-482b-a329-92bbf6fb20a6 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:25:59.939916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:25:59.940589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:25:59.940870 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:25:59.941148 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:25:59.941919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:25:59.943841 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:25:59.975689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1215/2380] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:25:59 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:25:59.977063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:25:59.994138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0c471-beb9-4dbd-bf86-9e7fd3c9af3b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:00.069971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:00.070703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:00.070993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:00.071547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:00.072244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:00.074241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:00.097128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1166/2381] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:25:59 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:00.098289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:00.109706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538c6be-687e-450d-b578-951aa48e3eb3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:00.125453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:00.126272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:00.126559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:00.127031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:00.128211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:00.130177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:00.145001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1216/2382] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:26:00.149755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:00.163428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e95058-d379-4d88-81de-8fab12c3ade2 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:00.168702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f84e7-8479-4e16-a16b-17cf26ec7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:00.169360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f84e7-8479-4e16-a16b-17cf26ec7b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:00.169655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f84e7-8479-4e16-a16b-17cf26ec7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:00.169928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f84e7-8479-4e16-a16b-17cf26ec7b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:00.170656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f84e7-8479-4e16-a16b-17cf26ec7b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:00.172301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f84e7-8479-4e16-a16b-17cf26ec7b03 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:00.184081 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1167/2383] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:00.188235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:00.200317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b994c-df85-4ad9-b1fc-6c4ab8412f56 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:00.205003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:00.205910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:00.206190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:00.206459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] PATH_INFO: `/v3/projects/f41f21b032124a3fa62356ed6f4024cf/users/b13b96e06c424735a812270c34402200/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:00.220140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:00.229614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41f21b032124a3fa62356ed6f4024cf, user_id=b13b96e06c424735a812270c34402200, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:00.232188 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:00.246548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1217/2384] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:26:00 2022] PUT /identity/v3/projects/f41f21b032124a3fa62356ed6f4024cf/users/b13b96e06c424735a812270c34402200/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:00.257568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75587ed9-f529-4215-9d52-7d3c212b360d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:00.257852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75587ed9-f529-4215-9d52-7d3c212b360d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:00.258124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75587ed9-f529-4215-9d52-7d3c212b360d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:00.286846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-75587ed9-f529-4215-9d52-7d3c212b360d None None] MFA Rules not processed for user `b13b96e06c424735a812270c34402200`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:00.288075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-75587ed9-f529-4215-9d52-7d3c212b360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:00.360112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1168/2385] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:00.371237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:00.372989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:00.452267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6dae0-598a-453e-b2e8-7aee686aeb5c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:00.455903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a451c61-e313-43c6-b70a-231a10f09afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:00.456539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451c61-e313-43c6-b70a-231a10f09afd service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:00.456819 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451c61-e313-43c6-b70a-231a10f09afd service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:00.457094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a451c61-e313-43c6-b70a-231a10f09afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:00.466037 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a451c61-e313-43c6-b70a-231a10f09afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:00.467512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a451c61-e313-43c6-b70a-231a10f09afd service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:00.477269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1218/2386] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:26:01.980838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:01.981409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:01.981409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:02.009153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] MFA Rules not processed for user `b13b96e06c424735a812270c34402200`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:02.010525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:02.017770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1169/2387] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:05.184969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4284-93db-42d7-84af-8f4e388b82d7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:05.185494 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4284-93db-42d7-84af-8f4e388b82d7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:05.185590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b4284-93db-42d7-84af-8f4e388b82d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:05.203422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-905b4284-93db-42d7-84af-8f4e388b82d7 None None] MFA Rules not processed for user `ecf6ed97c0eb4db68cf951044ce9ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:05.204631 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-905b4284-93db-42d7-84af-8f4e388b82d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:05.258159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1219/2388] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:12.002890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:15.251442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:24.551994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:24.553644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:24.633288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079376b-f3d9-477c-9734-a21fcc777944 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:24.637922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:24.638835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:24.639116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:24.639400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] PATH_INFO: `/v3/users/e062a6c5e9a94e10ac03c041e337a2c3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:24.640852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e062a6c5e9a94e10ac03c041e337a2c3)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:24.642845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:24.693971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e062a6c5e9a94e10ac03c041e337a2c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:24.707897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e062a6c5e9a94e10ac03c041e337a2c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:24.708624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e062a6c5e9a94e10ac03c041e337a2c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:24.709782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e062a6c5e9a94e10ac03c041e337a2c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:24.718448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-49e02552-7a5e-4e61-ac8c-4878a385e538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e062a6c5e9a94e10ac03c041e337a2c3'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:24.734303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1170/2389] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:26:24 2022] DELETE /identity/v3/users/e062a6c5e9a94e10ac03c041e337a2c3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:25.222821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b4284-93db-42d7-84af-8f4e388b82d7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:25.259302 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b4284-93db-42d7-84af-8f4e388b82d7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:25.331911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:25.332791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:25.333098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:25.333383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] PATH_INFO: `/v3/projects/7a1214d68d944c2980887bcef3335c16` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:25.334669 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1214d68d944c2980887bcef3335c16)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:25.336765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:25.402858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1214d68d944c2980887bcef3335c16', 'request_id': 'req-9aaddaab-1d38-437e-9777-3c41c3b2b78b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:25.418751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1214d68d944c2980887bcef3335c16', 'request_id': 'req-9aaddaab-1d38-437e-9777-3c41c3b2b78b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:25.434390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1214d68d944c2980887bcef3335c16', 'request_id': 'req-9aaddaab-1d38-437e-9777-3c41c3b2b78b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:25.454860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] The token cache is being invalidate because project 7a1214d68d944c2980887bcef3335c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:26:25.455336 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:25.456249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9aaddaab-1d38-437e-9777-3c41c3b2b78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:25.458964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1220/2390] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:26:25 2022] DELETE /identity/v3/projects/7a1214d68d944c2980887bcef3335c16 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:25.466214 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58348f5a-0a2b-46b1-b47b-a180d115173c None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:25.466677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58348f5a-0a2b-46b1-b47b-a180d115173c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:25.467138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58348f5a-0a2b-46b1-b47b-a180d115173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:25.511978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-58348f5a-0a2b-46b1-b47b-a180d115173c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:25.513953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-58348f5a-0a2b-46b1-b47b-a180d115173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:25.694738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1171/2391] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:25.706725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e183950-fc1b-446c-ae44-19a042c3b087 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:25.707018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e183950-fc1b-446c-ae44-19a042c3b087 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:25.707306 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e183950-fc1b-446c-ae44-19a042c3b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:25.749023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6e183950-fc1b-446c-ae44-19a042c3b087 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:25.751033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6e183950-fc1b-446c-ae44-19a042c3b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:25.764039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1221/2392] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:25.773282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58348f5a-0a2b-46b1-b47b-a180d115173c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:25.784721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58348f5a-0a2b-46b1-b47b-a180d115173c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:25.796795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:25.797822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:25.798053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:25.798339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:25.799153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:25.799472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:25.801422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:25.834225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1172/2393] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:25.847927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e183950-fc1b-446c-ae44-19a042c3b087 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:25.865330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e183950-fc1b-446c-ae44-19a042c3b087 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:25.873825 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d594d3-cbf0-400b-a4f6-58ebbf830c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:25.874972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d594d3-cbf0-400b-a4f6-58ebbf830c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:25.875407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d594d3-cbf0-400b-a4f6-58ebbf830c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:25.875906 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d594d3-cbf0-400b-a4f6-58ebbf830c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:25.877170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d594d3-cbf0-400b-a4f6-58ebbf830c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:25.881600 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d594d3-cbf0-400b-a4f6-58ebbf830c7b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:25.931301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1222/2394] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:26:25 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:25.932551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:25.941831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacb27-c8c6-4eac-8714-9e3c6852d99d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:25.942117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacb27-c8c6-4eac-8714-9e3c6852d99d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:25.942453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feacb27-c8c6-4eac-8714-9e3c6852d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:25.945140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73711fd1-bc4b-458b-9e32-0c755d9a9279 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:25.950663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:25.964296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1feacb27-c8c6-4eac-8714-9e3c6852d99d None None] MFA Rules not processed for user `e7f3274a762a4e1c8ae1474ffcbe912d`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:25.965533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1feacb27-c8c6-4eac-8714-9e3c6852d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:26.033982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1223/2395] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:26:26.043556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.044657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.045164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.045667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.046786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.050061 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.092858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1173/2396] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:26:25 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:26.094954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feacb27-c8c6-4eac-8714-9e3c6852d99d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.115445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feacb27-c8c6-4eac-8714-9e3c6852d99d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.124953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.126662 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.127209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.127697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.129125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.132562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.135313 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:26.161205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1224/2397] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:26.162830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.177588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc6b6-c739-4a8f-8cbb-bae98a06cd43 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.188167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea4362-b21b-444c-9700-305079141ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.189041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4362-b21b-444c-9700-305079141ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.190608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4362-b21b-444c-9700-305079141ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.191649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4362-b21b-444c-9700-305079141ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.192584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea4362-b21b-444c-9700-305079141ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.194276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea4362-b21b-444c-9700-305079141ccf admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.217947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1174/2398] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:26.219560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.235539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d665a8-e66d-4019-af6c-6212c706bf0f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.243022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.244410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.244857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.245273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] PATH_INFO: `/v3/projects/7cf1b6f5f2de4a079ddce00779fb67d3/users/b5c6ce36b61745a38e07b2f39b1d5a7b/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.279229 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf1b6f5f2de4a079ddce00779fb67d3, user_id=b5c6ce36b61745a38e07b2f39b1d5a7b, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.285253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.315478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1225/2399] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:26:26 2022] PUT /identity/v3/projects/7cf1b6f5f2de4a079ddce00779fb67d3/users/b5c6ce36b61745a38e07b2f39b1d5a7b/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:26.322398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37663b8-63c9-410b-9f46-255e871552f3 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.323398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37663b8-63c9-410b-9f46-255e871552f3 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.324309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37663b8-63c9-410b-9f46-255e871552f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.365306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a37663b8-63c9-410b-9f46-255e871552f3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:26.366615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a37663b8-63c9-410b-9f46-255e871552f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:26.475641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1175/2400] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:26.501106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.503950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:26.592743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a2fb-c490-4b01-92a0-ac4a542bba59 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:26.598253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:26.598888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.599268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.599620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.614423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:26.616035 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:26.642024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1226/2401] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:26:26.850924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec54685-3cd9-4c07-8227-5990a5f039ed None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:26.851862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec54685-3cd9-4c07-8227-5990a5f039ed None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:26.852585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec54685-3cd9-4c07-8227-5990a5f039ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:26.872701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-dec54685-3cd9-4c07-8227-5990a5f039ed None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:26.874303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-dec54685-3cd9-4c07-8227-5990a5f039ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:26.944773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1176/2402] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:26.963424 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:26.965670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:27.074584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194316c-c957-48f6-aa7e-ec9db854346f service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:27.080962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:27.081722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:27.082006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:27.082255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:27.092249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:27.093862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:27.111041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1227/2403] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:26:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:26:27.991006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5a3ff-f012-4a7f-908f-d904b899e9c8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:27.991523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5a3ff-f012-4a7f-908f-d904b899e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:27.991523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5a3ff-f012-4a7f-908f-d904b899e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:28.046860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d0b5a3ff-f012-4a7f-908f-d904b899e9c8 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:28.048860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d0b5a3ff-f012-4a7f-908f-d904b899e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:28.102592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1177/2404] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 30 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:28.117652 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:28.136376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6455a-6834-4ec3-9fcf-df374668c176 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:28.153910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:28.154960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:28.155428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:28.155921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:28.170894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:28.179389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:28.198054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1228/2405] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:26:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:26:28.510973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630ca0-b26e-41dc-8654-b4b8068c05cc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:28.511545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630ca0-b26e-41dc-8654-b4b8068c05cc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:28.512100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630ca0-b26e-41dc-8654-b4b8068c05cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:28.542590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f6630ca0-b26e-41dc-8654-b4b8068c05cc None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:28.544395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f6630ca0-b26e-41dc-8654-b4b8068c05cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:28.563029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1178/2406] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:26:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:28.577278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:28.589056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e86938-718d-4c69-8fb3-e80129fe8c53 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:28.595974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:28.596625 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:28.596905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:28.597785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:28.607426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:28.609489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:28.626180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1229/2407] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:26:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:26:29.023803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:29.024536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:29.024536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:29.046541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:29.047840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:29.056314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1179/2408] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 30 10:26:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:29.072201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:29.085415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd27fc-e67a-49c5-8878-74ec05f3f716 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:29.094167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b23e9-1ca1-48b7-bf1d-cb16e2d580be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:29.095178 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b23e9-1ca1-48b7-bf1d-cb16e2d580be service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:29.095711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b23e9-1ca1-48b7-bf1d-cb16e2d580be service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:29.096317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b23e9-1ca1-48b7-bf1d-cb16e2d580be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:29.108249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b23e9-1ca1-48b7-bf1d-cb16e2d580be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:29.110584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b23e9-1ca1-48b7-bf1d-cb16e2d580be service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:29.122080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1230/2409] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 10:26:31.688688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:31.690502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:31.707836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f1997-7e53-4a4c-ad1c-505bee4022ef None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:31.713259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:31.714141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.714808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.715108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] PATH_INFO: `/v3/users/b13b96e06c424735a812270c34402200` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.716425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13b96e06c424735a812270c34402200)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:31.718378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:31.726073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:31.800318 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13b96e06c424735a812270c34402200'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:31.830209 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13b96e06c424735a812270c34402200'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:31.830992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13b96e06c424735a812270c34402200'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:31.832433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13b96e06c424735a812270c34402200'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:31.841655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13b96e06c424735a812270c34402200'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:31.863472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1180/2410] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:26:31 2022] DELETE /identity/v3/users/b13b96e06c424735a812270c34402200 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:31.868443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:31.869316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:31.869683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:31.905799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:31.907099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:31.936203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:32.003876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1231/2411] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:26:32.015085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:32.017417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:32.133048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c940-7cab-4984-b47d-ad2b15c2e27f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:32.139576 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efe4b9-fd55-46e3-a721-5fb00502e0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:32.140553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efe4b9-fd55-46e3-a721-5fb00502e0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:32.141002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efe4b9-fd55-46e3-a721-5fb00502e0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:32.141428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efe4b9-fd55-46e3-a721-5fb00502e0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:32.157015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efe4b9-fd55-46e3-a721-5fb00502e0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:32.159258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efe4b9-fd55-46e3-a721-5fb00502e0c0 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:32.186000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1181/2412] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:26:32.501440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:32.503926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:32.517549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca27b9-0f02-48f1-b722-984a6c984bff None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:32.524505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:32.525718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:32.526069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:32.526418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] PATH_INFO: `/v3/projects/f41f21b032124a3fa62356ed6f4024cf` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:32.528053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41f21b032124a3fa62356ed6f4024cf)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:32.530751 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:32.596368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41f21b032124a3fa62356ed6f4024cf', 'request_id': 'req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:32.606186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41f21b032124a3fa62356ed6f4024cf', 'request_id': 'req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:32.615251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41f21b032124a3fa62356ed6f4024cf', 'request_id': 'req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:32.629879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] The token cache is being invalidate because project f41f21b032124a3fa62356ed6f4024cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:26:32.632333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:32.632333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-fee0b561-e912-45d7-95e1-f5fab6ab2aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:32.645026 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1232/2413] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:26:32 2022] DELETE /identity/v3/projects/f41f21b032124a3fa62356ed6f4024cf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:32.646814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e8fb7-f0bb-440e-8de6-76050017cd9e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:32.647113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e8fb7-f0bb-440e-8de6-76050017cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:32.647393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e8fb7-f0bb-440e-8de6-76050017cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:32.668000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4e6e8fb7-f0bb-440e-8de6-76050017cd9e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:32.669283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4e6e8fb7-f0bb-440e-8de6-76050017cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:32.748988 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1182/2414] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:26:32.758096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f71ef-ef9f-45ee-b163-19ed08f1a63d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:32.758393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f71ef-ef9f-45ee-b163-19ed08f1a63d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:32.758710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f71ef-ef9f-45ee-b163-19ed08f1a63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:32.792586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-606f71ef-ef9f-45ee-b163-19ed08f1a63d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:32.793849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-606f71ef-ef9f-45ee-b163-19ed08f1a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:32.819427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1233/2415] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:32.821194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e8fb7-f0bb-440e-8de6-76050017cd9e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:32.833871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e8fb7-f0bb-440e-8de6-76050017cd9e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:32.839019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:32.839801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:32.840141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:32.840424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:32.841180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:32.841490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:32.843495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:32.860480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1183/2416] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:26:32.865589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f71ef-ef9f-45ee-b163-19ed08f1a63d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:32.875924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f71ef-ef9f-45ee-b163-19ed08f1a63d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:32.893828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:32.894522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:32.894842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:32.895184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:32.895888 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:32.897859 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:32.964312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1234/2417] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:26:32 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:32.969418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:32.994405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f1e6-3c77-475e-8027-62ac03eca1ce admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.012539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:33.119396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.125746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.126073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.126418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.127205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:33.132071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:33.182980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1184/2418] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:26:32 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:33.188886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.217146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341f140-2eaa-4e25-a3e0-fa827c0f7ba3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.237138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.239752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.240534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.241748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.243846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:33.246363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:33.270849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1235/2419] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:33.271448 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.284168 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05599bed-71e4-4bca-8569-efa887d15b85 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.296104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cccfdb-90fc-4acc-b8b1-2c0fef0b4b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.297204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cccfdb-90fc-4acc-b8b1-2c0fef0b4b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.297608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cccfdb-90fc-4acc-b8b1-2c0fef0b4b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.298214 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cccfdb-90fc-4acc-b8b1-2c0fef0b4b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.299406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cccfdb-90fc-4acc-b8b1-2c0fef0b4b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:33.302340 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cccfdb-90fc-4acc-b8b1-2c0fef0b4b6a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:33.319636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1185/2420] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:26:33.321286 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.333114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cb951-c048-4563-8b76-8e611f9a8769 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.338785 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.339787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.340283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.340772 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] PATH_INFO: `/v3/projects/6ce469fbc99a4eda8d04a05fff49eae1/users/5ecc31b1682c4c2d9be918fcfecf2c9c/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.365325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce469fbc99a4eda8d04a05fff49eae1, user_id=5ecc31b1682c4c2d9be918fcfecf2c9c, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:33.370167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:33.397737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1236/2421] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:26:33 2022] PUT /identity/v3/projects/6ce469fbc99a4eda8d04a05fff49eae1/users/5ecc31b1682c4c2d9be918fcfecf2c9c/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:33.408652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb955b54-8346-4fc3-ab0b-3744bf7f20b7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.409102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb955b54-8346-4fc3-ab0b-3744bf7f20b7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.410449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb955b54-8346-4fc3-ab0b-3744bf7f20b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.447998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-cb955b54-8346-4fc3-ab0b-3744bf7f20b7 None None] MFA Rules not processed for user `5ecc31b1682c4c2d9be918fcfecf2c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:33.449299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-cb955b54-8346-4fc3-ab0b-3744bf7f20b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:33.595000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1186/2422] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:33.606761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:33.608976 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:33.743754 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:33.771387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda5757-c41d-4a99-b0cd-ccdcb4ee9841 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:33.782161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:33.783123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:33.783404 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:33.783677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:33.808463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:33.810329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:33.836692 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1237/2423] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:26:34.247634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77918-f80f-4e58-a6b5-17eb30dbf799 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.248512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77918-f80f-4e58-a6b5-17eb30dbf799 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.248822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da77918-f80f-4e58-a6b5-17eb30dbf799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.301287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0da77918-f80f-4e58-a6b5-17eb30dbf799 None None] MFA Rules not processed for user `b5c6ce36b61745a38e07b2f39b1d5a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:34.303365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0da77918-f80f-4e58-a6b5-17eb30dbf799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:34.483113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1187/2424] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:34.488224 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:34.489769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:34.585702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb6b83-1e2c-4935-b227-c911648c9353 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.591398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.592354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.593089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.593089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.593764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.595930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.638730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1238/2425] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:26:34 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:34.640441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77918-f80f-4e58-a6b5-17eb30dbf799 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:34.664734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da77918-f80f-4e58-a6b5-17eb30dbf799 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.680065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:34.753151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.753842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.754123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.754398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.755330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.762534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.795390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1188/2426] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:26:34 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:34.799660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:34.812964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f847f-211d-45f8-92dc-df46967458dc admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.820861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.821749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.822081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.822484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.823575 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.825981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.842730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1239/2427] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:34.847821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:34.864551 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f775e4-e4ce-4f19-bc38-59e2f9e89317 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:34.882143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:34.885732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:34.886521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:34.890751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] PATH_INFO: `/v3/projects/7824505946a2487e98958bdbd78ee180/users/f0e8578a142e4a2f9b9015338e4dfe37/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:34.912744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7824505946a2487e98958bdbd78ee180, user_id=f0e8578a142e4a2f9b9015338e4dfe37, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:34.917418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:34.942285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1189/2428] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:26:34 2022] PUT /identity/v3/projects/7824505946a2487e98958bdbd78ee180/users/f0e8578a142e4a2f9b9015338e4dfe37/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:34.946529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:34.959413 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d12f83-6e1d-49e2-b645-5b0874f43311 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:35.053533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d272544-7d3a-4272-9559-3eceb428f725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:35.054943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272544-7d3a-4272-9559-3eceb428f725 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:35.055618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272544-7d3a-4272-9559-3eceb428f725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:35.056269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272544-7d3a-4272-9559-3eceb428f725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:35.057677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d272544-7d3a-4272-9559-3eceb428f725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:35.060814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d272544-7d3a-4272-9559-3eceb428f725 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:35.091659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1240/2429] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:35.094974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:35.112884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ae126-aaff-4faf-a7ea-91bb22120d1e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:35.121495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0864ba0-21e5-4a4a-89fd-7df32db63bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:35.121495 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0864ba0-21e5-4a4a-89fd-7df32db63bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:35.123078 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0864ba0-21e5-4a4a-89fd-7df32db63bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:35.123182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0864ba0-21e5-4a4a-89fd-7df32db63bde admin admin] PATH_INFO: `/v3/projects/7824505946a2487e98958bdbd78ee180/users/f0e8578a142e4a2f9b9015338e4dfe37/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:35.129027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0864ba0-21e5-4a4a-89fd-7df32db63bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7824505946a2487e98958bdbd78ee180, user_id=f0e8578a142e4a2f9b9015338e4dfe37, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:35.132135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0864ba0-21e5-4a4a-89fd-7df32db63bde admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:35.145430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1190/2430] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:26:35 2022] PUT /identity/v3/projects/7824505946a2487e98958bdbd78ee180/users/f0e8578a142e4a2f9b9015338e4dfe37/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:26:41.195310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.196218 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.196516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.216821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] MFA Rules not processed for user `4c65e6495f7e43408c26706c89f61ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:41.218641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:41.344657 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1241/2431] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:41.677746 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eef371-18b3-46d9-aa4e-1f601473b00f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.678417 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eef371-18b3-46d9-aa4e-1f601473b00f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.679183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eef371-18b3-46d9-aa4e-1f601473b00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:41.716534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-49eef371-18b3-46d9-aa4e-1f601473b00f None None] MFA Rules not processed for user `f0e8578a142e4a2f9b9015338e4dfe37`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:41.717891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-49eef371-18b3-46d9-aa4e-1f601473b00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:41.806343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1191/2432] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:26:41.822890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:41.824462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:41.835655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:41.948157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffed29d-3d51-465b-b804-9fe30b34dade None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:41.954940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080e1c0-5a9c-4678-b30d-36d09e0a84c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:41.955440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e1c0-5a9c-4678-b30d-36d09e0a84c3 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:41.955721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e1c0-5a9c-4678-b30d-36d09e0a84c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:41.956021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e1c0-5a9c-4678-b30d-36d09e0a84c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:42.023627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080e1c0-5a9c-4678-b30d-36d09e0a84c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:42.025547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080e1c0-5a9c-4678-b30d-36d09e0a84c3 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:42.037663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1242/2433] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:26:51.802671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=73,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:52.031879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=55 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:53.073206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eef371-18b3-46d9-aa4e-1f601473b00f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:53.145470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eef371-18b3-46d9-aa4e-1f601473b00f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:53.153197 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:53.154084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.154851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.154851 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] PATH_INFO: `/v3/users/5ecc31b1682c4c2d9be918fcfecf2c9c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.155858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecc31b1682c4c2d9be918fcfecf2c9c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:53.157816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.216006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecc31b1682c4c2d9be918fcfecf2c9c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.232381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecc31b1682c4c2d9be918fcfecf2c9c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.233694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecc31b1682c4c2d9be918fcfecf2c9c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.234363 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecc31b1682c4c2d9be918fcfecf2c9c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.242183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecc31b1682c4c2d9be918fcfecf2c9c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.262124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1192/2434] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:26:53 2022] DELETE /identity/v3/users/5ecc31b1682c4c2d9be918fcfecf2c9c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:53.266628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.267127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.267248 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.287747 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:53.289072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:53.355487 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1243/2435] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:53.368668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:53.370278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:53.431854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d164f0-8005-48ca-bea8-6f8b5fe04883 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:53.435497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62761b4-d5cf-4f4a-ab3b-c41299a1427c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:53.436145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62761b4-d5cf-4f4a-ab3b-c41299a1427c service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.436431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62761b4-d5cf-4f4a-ab3b-c41299a1427c service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.436705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62761b4-d5cf-4f4a-ab3b-c41299a1427c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.447210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62761b4-d5cf-4f4a-ab3b-c41299a1427c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:53.448668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62761b4-d5cf-4f4a-ab3b-c41299a1427c service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.459898 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1193/2436] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:26:53.779777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:53.781296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:53.794144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16743ff6-3f24-49d6-8123-1dd7c291b336 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:53.800222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:53.801382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.801664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.801944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] PATH_INFO: `/v3/projects/6ce469fbc99a4eda8d04a05fff49eae1` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.803529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce469fbc99a4eda8d04a05fff49eae1)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:53.805474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:53.854559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce469fbc99a4eda8d04a05fff49eae1', 'request_id': 'req-7f849e1f-5892-4a9f-8cba-256f4403b54b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.862732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce469fbc99a4eda8d04a05fff49eae1', 'request_id': 'req-7f849e1f-5892-4a9f-8cba-256f4403b54b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.869041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce469fbc99a4eda8d04a05fff49eae1', 'request_id': 'req-7f849e1f-5892-4a9f-8cba-256f4403b54b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.879797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] The token cache is being invalidate because project 6ce469fbc99a4eda8d04a05fff49eae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:26:53.880081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.880709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7f849e1f-5892-4a9f-8cba-256f4403b54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:26:53.882254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1244/2437] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:26:53 2022] DELETE /identity/v3/projects/6ce469fbc99a4eda8d04a05fff49eae1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:53.887219 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7c013-b08a-4c9d-9307-15e1eb7ed497 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.887510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7c013-b08a-4c9d-9307-15e1eb7ed497 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.887784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7c013-b08a-4c9d-9307-15e1eb7ed497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.906679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-82b7c013-b08a-4c9d-9307-15e1eb7ed497 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:53.907916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-82b7c013-b08a-4c9d-9307-15e1eb7ed497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:53.925445 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:53.969208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1194/2438] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:53.977332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b2a3-7886-4c00-a6dd-ef7a7f5f52d6 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:53.977619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b2a3-7886-4c00-a6dd-ef7a7f5f52d6 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:53.977896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b2a3-7886-4c00-a6dd-ef7a7f5f52d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:53.997946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-3266b2a3-7886-4c00-a6dd-ef7a7f5f52d6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:53.999550 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-3266b2a3-7886-4c00-a6dd-ef7a7f5f52d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.007876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1245/2439] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:54.012162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7c013-b08a-4c9d-9307-15e1eb7ed497 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.021845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7c013-b08a-4c9d-9307-15e1eb7ed497 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.026475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.027152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.027438 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.027715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.028744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:26:54.029056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.030665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.046089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1195/2440] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:26:54.051608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266b2a3-7886-4c00-a6dd-ef7a7f5f52d6 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.062147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266b2a3-7886-4c00-a6dd-ef7a7f5f52d6 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.067164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.067889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.068114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.068392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.069100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.071344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.101635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1246/2441] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:26:54 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:54.106058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.117132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816727aa-faa8-4b48-bdb9-26c54f4993c5 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.177042 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.177732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.178008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.178301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.179031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.180968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.203887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1196/2442] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:26:54 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:26:54.205157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.218800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5774619-1593-45a5-b685-50c216191e26 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.224181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.224811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.225096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.225368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.226102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.227743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.238882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1247/2443] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:54.242952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.253137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f9be5-6714-4229-8d9b-ca43fef2c978 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.257887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078df1-108a-4deb-ae63-be5f1f5fea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.258541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078df1-108a-4deb-ae63-be5f1f5fea55 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.258866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078df1-108a-4deb-ae63-be5f1f5fea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.259164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078df1-108a-4deb-ae63-be5f1f5fea55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.259922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078df1-108a-4deb-ae63-be5f1f5fea55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.261536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078df1-108a-4deb-ae63-be5f1f5fea55 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.271958 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1197/2444] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:26:54.275898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.286900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dea5d-0ca8-4091-8408-a940a481eb15 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.291808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.292685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.292975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.293255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] PATH_INFO: `/v3/projects/6bf471198043490896b5f99c7e004168/users/9d931bcea07342a5a74a5d9de64d1465/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.310746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf471198043490896b5f99c7e004168, user_id=9d931bcea07342a5a74a5d9de64d1465, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.313405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.326542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1248/2445] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:26:54 2022] PUT /identity/v3/projects/6bf471198043490896b5f99c7e004168/users/9d931bcea07342a5a74a5d9de64d1465/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:26:54.332258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.332555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.332840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.354096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:54.355447 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.400801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.402531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.426793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1198/2446] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:54.429836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.436283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.437866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.485800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c354e-9a04-4a2b-9224-ba3c66aa30fc admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.493429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:54.503296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83060dd0-9f0f-45f2-a6dc-946726c0d2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.504533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83060dd0-9f0f-45f2-a6dc-946726c0d2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.504910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83060dd0-9f0f-45f2-a6dc-946726c0d2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.505797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83060dd0-9f0f-45f2-a6dc-946726c0d2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.524683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79ef6-77ea-4c1f-8936-9100acde9fbf None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.525038 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-83060dd0-9f0f-45f2-a6dc-946726c0d2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.532980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.534529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.534839 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.535291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.548694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.550328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.561667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1199/2447] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:26:54.642704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:54.652918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406633-15c0-479b-aa5e-3823680e3e03 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:54.657634 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:54.658375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:54.658707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:54.658992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:54.666208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:54.666646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83060dd0-9f0f-45f2-a6dc-946726c0d2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.668623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83060dd0-9f0f-45f2-a6dc-946726c0d2f8 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.681765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1249/2448] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:26:54.686036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:54.687637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:54.701394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1200/2449] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:26:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:26:59.720126 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce655-8221-4ed3-827c-4f135af20ea3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.720634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce655-8221-4ed3-827c-4f135af20ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.720748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce655-8221-4ed3-827c-4f135af20ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.748560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-179ce655-8221-4ed3-827c-4f135af20ea3 None None] MFA Rules not processed for user `9d931bcea07342a5a74a5d9de64d1465`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:26:59.749793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-179ce655-8221-4ed3-827c-4f135af20ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:26:59.826848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1250/2450] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:26:59.827436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.840249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8df00e-9b00-4993-a283-f43b5d3a6b39 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.848684 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.849396 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.849721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.850009 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.850756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.852698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:26:59.893744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1201/2451] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:26:59 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:26:59.895635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ce655-8221-4ed3-827c-4f135af20ea3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:26:59.906451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ce655-8221-4ed3-827c-4f135af20ea3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:26:59.971753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=100 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:26:59.995211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:26:59.995925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:26:59.996416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:26:59.996791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:26:59.997592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:26:59.999686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:00.030420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1251/2452] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:26:59 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:27:00.035022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:00.045564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501dfc-378e-41bb-9837-8224fb113219 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:00.051321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:00.051992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:00.052275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:00.052552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:00.053279 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:00.054967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:00.066470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1202/2453] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:27:00.070664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:00.083604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368ad9c-38b2-4fa7-bc48-4374882948ff admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:00.089053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:00.089949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:00.090227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:00.090495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] PATH_INFO: `/v3/projects/54ec9ab577e84767a148aad395e009ef/users/a510223a6c174d59a4eae7ca670f19af/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:00.107705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec9ab577e84767a148aad395e009ef, user_id=a510223a6c174d59a4eae7ca670f19af, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:00.110508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:00.125337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1252/2454] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:27:00 2022] PUT /identity/v3/projects/54ec9ab577e84767a148aad395e009ef/users/a510223a6c174d59a4eae7ca670f19af/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:27:00.129879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:00.140534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a2d5-6494-4039-9a44-f69677b381f8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:00.195874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86c1a3-ecb5-4da7-9a47-942fd748b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:00.196525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c1a3-ecb5-4da7-9a47-942fd748b088 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:00.196808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c1a3-ecb5-4da7-9a47-942fd748b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:00.197083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c1a3-ecb5-4da7-9a47-942fd748b088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:00.197798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86c1a3-ecb5-4da7-9a47-942fd748b088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:00.199439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86c1a3-ecb5-4da7-9a47-942fd748b088 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:00.209143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1203/2455] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:27:00.213487 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:00.224752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d47b-5081-4bd0-9bbc-ebf877ee9827 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:00.229678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9c934-4521-4b41-b26d-22840307819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:00.230560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9c934-4521-4b41-b26d-22840307819f admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:00.230879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9c934-4521-4b41-b26d-22840307819f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:00.231159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9c934-4521-4b41-b26d-22840307819f admin admin] PATH_INFO: `/v3/projects/54ec9ab577e84767a148aad395e009ef/users/a510223a6c174d59a4eae7ca670f19af/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:00.233140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9c934-4521-4b41-b26d-22840307819f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec9ab577e84767a148aad395e009ef, user_id=a510223a6c174d59a4eae7ca670f19af, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:00.235824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9c934-4521-4b41-b26d-22840307819f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:00.247002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1253/2456] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:27:00 2022] PUT /identity/v3/projects/54ec9ab577e84767a148aad395e009ef/users/a510223a6c174d59a4eae7ca670f19af/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:27:03.321773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:03.322655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:03.323134 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:03.342754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] MFA Rules not processed for user `b5c6ce36b61745a38e07b2f39b1d5a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:03.344215 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:03.419675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1204/2457] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:27:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:27:06.273261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fa25-867f-4891-847e-054a66b9474b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.273686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fa25-867f-4891-847e-054a66b9474b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.273855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7fa25-867f-4891-847e-054a66b9474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.309289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-6be7fa25-867f-4891-847e-054a66b9474b None None] MFA Rules not processed for user `a510223a6c174d59a4eae7ca670f19af`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:06.310619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-6be7fa25-867f-4891-847e-054a66b9474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:06.489131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1254/2458] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:27:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:27:06.502524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:06.503985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:06.535750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:06.565430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366fac3-5239-4908-8d5e-04308cf71530 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:06.569173 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40a1f11c5cd4b48be27dd1a0f48bdc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:06.569829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.570376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.570753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.631677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:06.633147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:06.642780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1205/2459] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:06.762267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:06.762722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:06.762998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:06.799948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:06.801180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:06.932537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1255/2460] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:27:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:27:06.957321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:06.958946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:07.054140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d0e4f-25c9-44b5-abdd-af6d09553385 service glance] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:07.062170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:07.062942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:07.063230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:07.063508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:07.073747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:07.075751 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:07.086035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1206/2461] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:27:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:27:12.126438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:12.128722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:12.174660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:12.206990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698b01-f049-495a-941d-6b3d8ae25344 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:12.216562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4a794-f303-4d46-8d9b-580de08b9848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:12.217518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a794-f303-4d46-8d9b-580de08b9848 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:12.217967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a794-f303-4d46-8d9b-580de08b9848 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:12.218401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4a794-f303-4d46-8d9b-580de08b9848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:12.223181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-57d4a794-f303-4d46-8d9b-580de08b9848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:12.295016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a794-f303-4d46-8d9b-580de08b9848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:12.296743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4a794-f303-4d46-8d9b-580de08b9848 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:12.309364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1256/2462] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:13.885776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:13.887940 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:13.904436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a9aba-4315-4bb7-9ecf-34d598bfef34 service swift] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:13.909482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:13.910282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:13.910701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:13.911154 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:13.913596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:13.982380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:13.985754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:14.006450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1207/2463] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:18.032064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.032621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.032621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.049372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] MFA Rules not processed for user `9d931bcea07342a5a74a5d9de64d1465`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:18.050574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:18.058217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1257/2464] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:27:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:27:18.561185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.571519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:18.621103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094115ce-ec82-4db4-83e6-203feae06359 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:18.625778 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c126695-fc43-493d-abc0-44a24f41b0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:18.627441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c126695-fc43-493d-abc0-44a24f41b0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:18.627441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c126695-fc43-493d-abc0-44a24f41b0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:18.627734 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c126695-fc43-493d-abc0-44a24f41b0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:18.629575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2c126695-fc43-493d-abc0-44a24f41b0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:18.639736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c126695-fc43-493d-abc0-44a24f41b0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:18.641360 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c126695-fc43-493d-abc0-44a24f41b0aa service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:18.650166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1208/2465] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:18.954021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:18.955603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:19.067117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f03a84-90c7-42ee-8c20-40591cede9a7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:19.073382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:19.074147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:19.074442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:19.074749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:19.076650 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:19.090837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:19.092793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:19.107039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1258/2466] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:22.733624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e3446-6b0d-4961-856f-9a5b2f4dd989 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.734149 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e3446-6b0d-4961-856f-9a5b2f4dd989 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.734803 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e3446-6b0d-4961-856f-9a5b2f4dd989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.761073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a42e3446-6b0d-4961-856f-9a5b2f4dd989 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:22.762453 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a42e3446-6b0d-4961-856f-9a5b2f4dd989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:22.774775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1209/2467] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:27:22.788489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:22.802331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15012f31-4325-4ed3-8204-955f750a6bfb service placement] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:22.809036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:22.810001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:22.810461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:22.811031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:22.821426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:22.823290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:22.832957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1259/2468] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:27:24.246413 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e3446-6b0d-4961-856f-9a5b2f4dd989 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:24.256769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e3446-6b0d-4961-856f-9a5b2f4dd989 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:24.261459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:24.262156 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:24.262373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:24.262648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:24.264814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:24.330410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:24.331982 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:24.341482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1210/2469] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:32.829199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=74 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:34.337192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=55 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:37.729609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.739124 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b3426-c417-492d-8215-d7356068e18f service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.742711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.743355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.743643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.743923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.745666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:37.755790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.757223 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.767197 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1260/2470] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:37.767636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:37.777034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9ac56-f47b-4355-9724-5b1baeea1298 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:37.780810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:37.781452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:37.781730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:37.781999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:37.790624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:37.792110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:37.800432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1211/2471] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:27:39.411382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:39.413398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:39.550746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fe608-cd52-4e2b-a981-98af744ca1c9 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:39.559918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:39.561407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:39.561697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:39.562033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:39.563898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:39.587165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:39.589055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:39.621145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1261/2472] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:40.265630 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:40.284516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178a23-3c53-4d80-84ac-446724fb2ddd service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:40.294003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18aba-8f3b-4ccc-a48a-bfd8f0b54d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:40.294967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18aba-8f3b-4ccc-a48a-bfd8f0b54d81 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:40.295415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18aba-8f3b-4ccc-a48a-bfd8f0b54d81 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:40.295908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18aba-8f3b-4ccc-a48a-bfd8f0b54d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:40.298333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-56a18aba-8f3b-4ccc-a48a-bfd8f0b54d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:40.320955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18aba-8f3b-4ccc-a48a-bfd8f0b54d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:40.323063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18aba-8f3b-4ccc-a48a-bfd8f0b54d81 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:40.340204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1212/2473] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:42.003070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:42.015317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007c6e-677d-4a72-8be6-52332bfe4b1e service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:42.022952 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:42.024344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.024727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.025099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.027132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:42.109316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:42.111728 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:42.124971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1262/2474] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:27:42.174211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057ade-288b-4f38-a864-01fd7f01945f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:42.174613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057ade-288b-4f38-a864-01fd7f01945f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:42.175207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057ade-288b-4f38-a864-01fd7f01945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:42.194831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4c057ade-288b-4f38-a864-01fd7f01945f None None] MFA Rules not processed for user `ecf6ed97c0eb4db68cf951044ce9ff2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:27:42.196203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4c057ade-288b-4f38-a864-01fd7f01945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:42.204518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1213/2475] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:27:52.119350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=68 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:52.189174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=15 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:27:53.325925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:53.338520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3573f4-c93b-44f5-830e-a6cbe42050c4 service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:53.344208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:53.344855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:53.345140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:53.345421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:53.347267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:53.361640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:53.363474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:53.374343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1263/2476] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:27:57.194035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057ade-288b-4f38-a864-01fd7f01945f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:27:57.204708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057ade-288b-4f38-a864-01fd7f01945f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:27:57.210366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:27:57.211059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:27:57.211343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:27:57.211622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:27:57.213563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:27:57.281271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:27:57.282864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:27:57.292776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1214/2477] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:01.056656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.058130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:01.076232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba262eaf-03fc-4f7a-970d-ca7ab84f53c5 service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.080833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.082215 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.082502 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.082817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] PATH_INFO: `/v3/users/e7f3274a762a4e1c8ae1474ffcbe912d` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.084014 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f3274a762a4e1c8ae1474ffcbe912d)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.085926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.136005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f3274a762a4e1c8ae1474ffcbe912d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.148541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f3274a762a4e1c8ae1474ffcbe912d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.149160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f3274a762a4e1c8ae1474ffcbe912d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.149766 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f3274a762a4e1c8ae1474ffcbe912d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.156847 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-abd5f8ff-5333-42a7-9e13-5c6ed80140d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f3274a762a4e1c8ae1474ffcbe912d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.170082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1264/2478] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:01 2022] DELETE /identity/v3/users/e7f3274a762a4e1c8ae1474ffcbe912d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:01.366820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.378901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73509d18-bbbe-4a2a-9773-43bf84104564 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.437859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.438786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.439022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.439296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] PATH_INFO: `/v3/projects/f3a09af8358a4c9ba551fc573ba84e09` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.440599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a09af8358a4c9ba551fc573ba84e09)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.443084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.493990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a09af8358a4c9ba551fc573ba84e09', 'request_id': 'req-6ba1cadd-3016-4eb4-94e9-ec68381dc782'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.502259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a09af8358a4c9ba551fc573ba84e09', 'request_id': 'req-6ba1cadd-3016-4eb4-94e9-ec68381dc782'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.509333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a09af8358a4c9ba551fc573ba84e09', 'request_id': 'req-6ba1cadd-3016-4eb4-94e9-ec68381dc782'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.523047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] The token cache is being invalidate because project f3a09af8358a4c9ba551fc573ba84e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:01.523334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.525428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-6ba1cadd-3016-4eb4-94e9-ec68381dc782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:01.525654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1215/2479] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:01 2022] DELETE /identity/v3/projects/f3a09af8358a4c9ba551fc573ba84e09 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:01.530649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe90f5-645e-4f92-9cad-f8df83bd449e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.530973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe90f5-645e-4f92-9cad-f8df83bd449e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.531250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe90f5-645e-4f92-9cad-f8df83bd449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.550125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d4fe90f5-645e-4f92-9cad-f8df83bd449e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:01.551373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d4fe90f5-645e-4f92-9cad-f8df83bd449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:01.614504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1265/2480] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:01.622343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60e42-5045-4687-ae89-402449b1ed7f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.622652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60e42-5045-4687-ae89-402449b1ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.622971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60e42-5045-4687-ae89-402449b1ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.641720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-65a60e42-5045-4687-ae89-402449b1ed7f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:01.642969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-65a60e42-5045-4687-ae89-402449b1ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:01.651618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1216/2481] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:01.655948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe90f5-645e-4f92-9cad-f8df83bd449e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.665812 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe90f5-645e-4f92-9cad-f8df83bd449e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.670457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.671156 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.671443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.671724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.672454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:01.672770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.674394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.687236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1266/2482] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:01.692136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a60e42-5045-4687-ae89-402449b1ed7f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.701553 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a60e42-5045-4687-ae89-402449b1ed7f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.706341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.707049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.707334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.707610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.708296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.710264 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.725077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:01.739572 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1217/2483] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:01 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:01.743586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.745822 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.747546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:01.754662 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb1b42-2f44-486f-b218-fc1b318cce95 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.804258 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:01.813755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddc9c-f5bb-42f6-b478-af8a45e04d92 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.818036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.818715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.819251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.819456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.819707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.820228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.820519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.820800 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.821366 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:01.821518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.823467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.845081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1267/2484] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:01 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:01.849234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.859900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23575d6f-6369-4052-aa70-21a7eb2c6e04 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.865489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.866153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.866444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.866753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.867485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.869091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.885811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1268/2485] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:01.886894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.893896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.895100 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.898947 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029090a-b511-4a49-9ef7-7547de781a70 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.903891 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8a510-4a77-4800-b345-3075afd4c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.905056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8a510-4a77-4800-b345-3075afd4c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.905415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8a510-4a77-4800-b345-3075afd4c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.905765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8a510-4a77-4800-b345-3075afd4c8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.906496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1218/2486] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:28:01.911019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8a510-4a77-4800-b345-3075afd4c8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.912765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8a510-4a77-4800-b345-3075afd4c8c8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.924901 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1269/2487] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:01.929412 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:01.941616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e087db4-156e-4935-a7c4-60bef33bff7e service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:01.946841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:01.947742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.948022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.948288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] PATH_INFO: `/v3/projects/816f2b9a19f14176be27f7e9338eb836/users/07537aba3eea4ada9333f59349b9191f/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:01.965303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816f2b9a19f14176be27f7e9338eb836, user_id=07537aba3eea4ada9333f59349b9191f, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:01.968398 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:01.984145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1219/2488] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:01 2022] PUT /identity/v3/projects/816f2b9a19f14176be27f7e9338eb836/users/07537aba3eea4ada9333f59349b9191f/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:01.989783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e073-22ef-4ba5-88c4-0dcf89f91ae0 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:01.990074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e073-22ef-4ba5-88c4-0dcf89f91ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:01.990412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328e073-22ef-4ba5-88c4-0dcf89f91ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.012967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2328e073-22ef-4ba5-88c4-0dcf89f91ae0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:02.014207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2328e073-22ef-4ba5-88c4-0dcf89f91ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:02.089150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1270/2489] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:02.099938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.102076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:02.162666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8b153-24e6-4cb9-ad3a-ee933a4eb344 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.166380 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.167232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.167519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.167802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.178237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.180151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:02.190011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1220/2490] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:02.846264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50cb3-334c-4dd4-9d02-8944d7cf1393 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.846811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50cb3-334c-4dd4-9d02-8944d7cf1393 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.847212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf50cb3-334c-4dd4-9d02-8944d7cf1393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.879418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ddf50cb3-334c-4dd4-9d02-8944d7cf1393 None None] MFA Rules not processed for user `07537aba3eea4ada9333f59349b9191f`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:02.881186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ddf50cb3-334c-4dd4-9d02-8944d7cf1393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:02.962042 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1271/2491] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:02.966973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:02.977946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533db44-43af-4995-a92c-2f2be85733aa service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:02.983265 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:02.984221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:02.984503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:02.984938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:02.985685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:02.987720 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.018725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1221/2492] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:02 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:03.022389 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50cb3-334c-4dd4-9d02-8944d7cf1393 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.038732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf50cb3-334c-4dd4-9d02-8944d7cf1393 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.116187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.141516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.142382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.142666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.142968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.143673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.146900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.172595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1272/2493] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:03 2022] POST /identity/v3/users => generated 309 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:03.177338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.187767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:03.195102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4da51-9060-4dfc-b98a-59aa8d9473c4 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.201494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.202194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.202481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.202873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.203613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.205304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.218203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1222/2494] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:03.222487 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.233852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c2dd0-0336-4b02-bbba-461dcd463e49 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.239231 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.240134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.240418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.240884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] PATH_INFO: `/v3/projects/2971f938ffad41af8b228cb2c5d01379/users/ab1a4467f6384b9980bbb6f42cb8fe61/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.260085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2971f938ffad41af8b228cb2c5d01379, user_id=ab1a4467f6384b9980bbb6f42cb8fe61, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.262787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.277207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1273/2495] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:03 2022] PUT /identity/v3/projects/2971f938ffad41af8b228cb2c5d01379/users/ab1a4467f6384b9980bbb6f42cb8fe61/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:03.281295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.291814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37358829-2952-49c2-9f95-7f5b846b571e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.361028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc7746-69ec-4cca-ac1f-e52651c5de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.361716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc7746-69ec-4cca-ac1f-e52651c5de9d admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.362031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc7746-69ec-4cca-ac1f-e52651c5de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.362515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc7746-69ec-4cca-ac1f-e52651c5de9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.364458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc7746-69ec-4cca-ac1f-e52651c5de9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.366675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc7746-69ec-4cca-ac1f-e52651c5de9d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.379663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1223/2496] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:03.384143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:03.396354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48292944-984c-4793-8d52-c2fd1ea6ead3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:03.401105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:03.401988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:03.402267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:03.402571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] PATH_INFO: `/v3/projects/2971f938ffad41af8b228cb2c5d01379/users/ab1a4467f6384b9980bbb6f42cb8fe61/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:03.404574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2971f938ffad41af8b228cb2c5d01379, user_id=ab1a4467f6384b9980bbb6f42cb8fe61, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:03.407322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:03.420401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1274/2497] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:03 2022] PUT /identity/v3/projects/2971f938ffad41af8b228cb2c5d01379/users/ab1a4467f6384b9980bbb6f42cb8fe61/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:04.101485 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befec21-54fd-4556-8c66-0ee74e5ed525 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:04.102341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befec21-54fd-4556-8c66-0ee74e5ed525 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:04.102840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befec21-54fd-4556-8c66-0ee74e5ed525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:04.134183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-4befec21-54fd-4556-8c66-0ee74e5ed525 None None] MFA Rules not processed for user `ab1a4467f6384b9980bbb6f42cb8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:04.135795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-4befec21-54fd-4556-8c66-0ee74e5ed525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:04.231051 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1224/2498] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:06.195821 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.266491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956816c-32b6-4347-953d-d19b3a5235aa admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.273495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.274380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.274665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.275170 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] PATH_INFO: `/v3/users/07537aba3eea4ada9333f59349b9191f` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.276397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07537aba3eea4ada9333f59349b9191f)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.278438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.364939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07537aba3eea4ada9333f59349b9191f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.385519 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07537aba3eea4ada9333f59349b9191f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.386210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07537aba3eea4ada9333f59349b9191f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.386864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07537aba3eea4ada9333f59349b9191f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.396752 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07537aba3eea4ada9333f59349b9191f'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.417022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1275/2499] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:06 2022] DELETE /identity/v3/users/07537aba3eea4ada9333f59349b9191f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:06.644954 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befec21-54fd-4556-8c66-0ee74e5ed525 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.658556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befec21-54fd-4556-8c66-0ee74e5ed525 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.733648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.734571 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.734892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.735174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] PATH_INFO: `/v3/projects/816f2b9a19f14176be27f7e9338eb836` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.738237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=816f2b9a19f14176be27f7e9338eb836)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.739772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.761176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.810657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816f2b9a19f14176be27f7e9338eb836', 'request_id': 'req-3efaca71-46f7-41f0-893f-81049c7085ba'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.820237 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816f2b9a19f14176be27f7e9338eb836', 'request_id': 'req-3efaca71-46f7-41f0-893f-81049c7085ba'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.828250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816f2b9a19f14176be27f7e9338eb836', 'request_id': 'req-3efaca71-46f7-41f0-893f-81049c7085ba'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.841946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] The token cache is being invalidate because project 816f2b9a19f14176be27f7e9338eb836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:06.842391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.843066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:06.844995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1225/2500] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:06 2022] DELETE /identity/v3/projects/816f2b9a19f14176be27f7e9338eb836 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:06.848803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:06.850311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:06.864524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b443c-4e70-4c00-8bfe-b2f0e177e754 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:06.883227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:06.938933 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:06.939621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:06.939918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:06.941245 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] PATH_INFO: `/v3/users/ab1a4467f6384b9980bbb6f42cb8fe61` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:06.942300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1a4467f6384b9980bbb6f42cb8fe61)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:06.944593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:06.999948 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1a4467f6384b9980bbb6f42cb8fe61'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.014530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1a4467f6384b9980bbb6f42cb8fe61'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.015225 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1a4467f6384b9980bbb6f42cb8fe61'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.015827 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1a4467f6384b9980bbb6f42cb8fe61'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.023565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b7ca9beb-31c3-42dd-9229-f95ec2e5a872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1a4467f6384b9980bbb6f42cb8fe61'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.050978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1276/2501] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:06 2022] DELETE /identity/v3/users/ab1a4467f6384b9980bbb6f42cb8fe61 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:07.231170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.232620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:07.259479 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efaca71-46f7-41f0-893f-81049c7085ba admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.322276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.323494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.323911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.324286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] PATH_INFO: `/v3/projects/2971f938ffad41af8b228cb2c5d01379` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.325694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2971f938ffad41af8b228cb2c5d01379)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.328070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.387633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2971f938ffad41af8b228cb2c5d01379', 'request_id': 'req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.396392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2971f938ffad41af8b228cb2c5d01379', 'request_id': 'req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.404493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2971f938ffad41af8b228cb2c5d01379', 'request_id': 'req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.432226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] The token cache is being invalidate because project 2971f938ffad41af8b228cb2c5d01379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:07.432800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.433637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-b852c5d3-5653-40c6-a0c4-4ae7e23658f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:07.435704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1226/2502] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:07 2022] DELETE /identity/v3/projects/2971f938ffad41af8b228cb2c5d01379 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:07.441164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ee14c-822a-4dfd-97db-58a4ac3d9d8c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.441697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ee14c-822a-4dfd-97db-58a4ac3d9d8c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.441697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ee14c-822a-4dfd-97db-58a4ac3d9d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.468530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d85ee14c-822a-4dfd-97db-58a4ac3d9d8c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:07.469779 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d85ee14c-822a-4dfd-97db-58a4ac3d9d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:07.541300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1277/2503] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:07.549296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee321-4635-4e99-8cad-51771ba83c15 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.549589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee321-4635-4e99-8cad-51771ba83c15 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.549933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ee321-4635-4e99-8cad-51771ba83c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.570458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-579ee321-4635-4e99-8cad-51771ba83c15 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:07.571730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-579ee321-4635-4e99-8cad-51771ba83c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:07.579782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1227/2504] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:07.584062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ee14c-822a-4dfd-97db-58a4ac3d9d8c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.594643 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ee14c-822a-4dfd-97db-58a4ac3d9d8c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.600152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.600895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.601246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.601606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.602419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:07.602849 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.604532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.623544 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1278/2505] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:07.624688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee321-4635-4e99-8cad-51771ba83c15 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.634314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ee321-4635-4e99-8cad-51771ba83c15 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.640121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b888b43-d65e-4ce1-93b4-a3d8869a1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.640809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888b43-d65e-4ce1-93b4-a3d8869a1535 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.641091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888b43-d65e-4ce1-93b4-a3d8869a1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.641374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888b43-d65e-4ce1-93b4-a3d8869a1535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.642086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b888b43-d65e-4ce1-93b4-a3d8869a1535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.644083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b888b43-d65e-4ce1-93b4-a3d8869a1535 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.671887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.689277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1228/2506] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:07 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:07.692492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.703433 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838f716-6395-4858-92c6-d18d865f245c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.727791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:07.786269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.787019 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.787305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.787580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.788277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.790328 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.806248 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.806537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.806857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.814982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1279/2507] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:07 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:07.818382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.825973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:07.827594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:07.830020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275bedf-7b66-448f-ac65-4a359cbcd735 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.835840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.836120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.836407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.836686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.837421 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.839048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.850663 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1280/2508] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:07.856668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.871278 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7c7a1-77f6-4651-896a-63d9c4775b3b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.876261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.876986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.877342 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.877684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.878531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.880315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.900101 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1281/2509] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:07.904161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.905213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1229/2510] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:28:07.917410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15fc17-9da9-40e9-abb2-4e3a6c22e868 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:07.924598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d154-e623-41aa-8c31-144813c39c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:07.925508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d154-e623-41aa-8c31-144813c39c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.925792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d154-e623-41aa-8c31-144813c39c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.926064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d154-e623-41aa-8c31-144813c39c0c admin admin] PATH_INFO: `/v3/projects/5f55e699c87e440488932e69ccb3b9b0/users/0adb2147fe154b59986666d7efdfda99/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.929288 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:07.931006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:07.943146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d154-e623-41aa-8c31-144813c39c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f55e699c87e440488932e69ccb3b9b0, user_id=0adb2147fe154b59986666d7efdfda99, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:07.946198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d154-e623-41aa-8c31-144813c39c0c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:07.963765 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1282/2511] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:07 2022] PUT /identity/v3/projects/5f55e699c87e440488932e69ccb3b9b0/users/0adb2147fe154b59986666d7efdfda99/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:07.973955 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e746-f31e-4958-95fb-898ec4b0f9e8 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:07.974395 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e746-f31e-4958-95fb-898ec4b0f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:07.974677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e746-f31e-4958-95fb-898ec4b0f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:07.999881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-dd37e746-f31e-4958-95fb-898ec4b0f9e8 None None] MFA Rules not processed for user `0adb2147fe154b59986666d7efdfda99`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:08.001100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-dd37e746-f31e-4958-95fb-898ec4b0f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:08.014046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a01a8-b6b1-46af-aedd-07f871acb38f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.067207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1283/2512] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:08.071709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e746-f31e-4958-95fb-898ec4b0f9e8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.078018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.078664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.078970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.079242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.125941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:08.130383 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:08.137469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e746-f31e-4958-95fb-898ec4b0f9e8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.139886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.141503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.142797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.143466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.144386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.144673 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.145373 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.147332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.151007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1230/2513] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:28:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 10:28:08.175501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1284/2514] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:08 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:08.179338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.194286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5a9e1-3f9e-4b65-8c20-75b23c379630 service swift] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.286717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.288120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.288961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.290067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.291680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.294170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.329443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1231/2515] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:08 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:08.333783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.348117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f228f-9764-48cc-86de-4b1f18193f62 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.352713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.353472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.353756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.354033 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.354807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.356638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.379139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1285/2516] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:08.380973 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.392275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98cd56-1513-434a-ada4-4cd3b98c3a08 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.400256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.401162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.401451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.401721 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] PATH_INFO: `/v3/projects/3738e92bfd0a4fe784ffff949278a1b2/users/50a36b1d57c34b95b2b50218514107b5/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.426281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3738e92bfd0a4fe784ffff949278a1b2, user_id=50a36b1d57c34b95b2b50218514107b5, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.429161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.447074 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1232/2517] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:08 2022] PUT /identity/v3/projects/3738e92bfd0a4fe784ffff949278a1b2/users/50a36b1d57c34b95b2b50218514107b5/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:08.451562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.462523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c13a6-2723-4de8-92e3-caa65be9e54f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.563890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c91119-45a0-4121-b2f9-c7119a3e4daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.565096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c91119-45a0-4121-b2f9-c7119a3e4daa admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.566169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c91119-45a0-4121-b2f9-c7119a3e4daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.566719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c91119-45a0-4121-b2f9-c7119a3e4daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.567706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c91119-45a0-4121-b2f9-c7119a3e4daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.571350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c91119-45a0-4121-b2f9-c7119a3e4daa admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.590015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1286/2518] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:08.594153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.619456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb25194-c149-4dce-9139-d6cf21a767f8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:08.641915 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:08.643601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.644136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.644532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] PATH_INFO: `/v3/projects/3738e92bfd0a4fe784ffff949278a1b2/users/50a36b1d57c34b95b2b50218514107b5/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.648364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3738e92bfd0a4fe784ffff949278a1b2, user_id=50a36b1d57c34b95b2b50218514107b5, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:08.652048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:08.680174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1233/2519] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:08 2022] PUT /identity/v3/projects/3738e92bfd0a4fe784ffff949278a1b2/users/50a36b1d57c34b95b2b50218514107b5/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:08.681356 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d521c-2a26-44f2-97ed-55df2ea27132 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:08.681645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d521c-2a26-44f2-97ed-55df2ea27132 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:08.681928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d521c-2a26-44f2-97ed-55df2ea27132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:08.726208 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ea6d521c-2a26-44f2-97ed-55df2ea27132 None None] MFA Rules not processed for user `50a36b1d57c34b95b2b50218514107b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:08.728099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ea6d521c-2a26-44f2-97ed-55df2ea27132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:08.837011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1287/2520] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:28:08.851177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:08.853236 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:08.999242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3ae4-afcf-4d29-8d04-20a3838d9ff1 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:09.003010 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949535ef-88fc-41be-a2e8-6659dcd42ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:09.003791 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949535ef-88fc-41be-a2e8-6659dcd42ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:09.004201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949535ef-88fc-41be-a2e8-6659dcd42ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:09.004483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949535ef-88fc-41be-a2e8-6659dcd42ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:09.015399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949535ef-88fc-41be-a2e8-6659dcd42ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:09.016969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949535ef-88fc-41be-a2e8-6659dcd42ee6 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:09.027886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1234/2521] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:28:10.830980 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d521c-2a26-44f2-97ed-55df2ea27132 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:10.900630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:10.921712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d521c-2a26-44f2-97ed-55df2ea27132 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:10.927349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:10.928306 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:10.928653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:10.928990 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] PATH_INFO: `/v3/users/0adb2147fe154b59986666d7efdfda99` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:10.930249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adb2147fe154b59986666d7efdfda99)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:10.932463 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.004935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adb2147fe154b59986666d7efdfda99'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.021453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adb2147fe154b59986666d7efdfda99'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.022190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adb2147fe154b59986666d7efdfda99'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.022834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adb2147fe154b59986666d7efdfda99'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.031053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adb2147fe154b59986666d7efdfda99'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.047713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1288/2522] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:10 2022] DELETE /identity/v3/users/0adb2147fe154b59986666d7efdfda99 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:11.052920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.053483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.053483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.075022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:11.076269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:11.133075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:11.176273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1235/2523] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:11.184936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.186563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:11.271010 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5c9b7-d397-43b6-a513-24ec1a7ed77b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.275473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.276205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.276563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.276911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.289053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.290656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.302982 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1289/2524] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:11.733836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.739442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:11.756664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5829b-4c02-4c13-8a80-3c49762bf6b6 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:11.763073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:11.764106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:11.764505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:11.764876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] PATH_INFO: `/v3/projects/5f55e699c87e440488932e69ccb3b9b0` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:11.766652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f55e699c87e440488932e69ccb3b9b0)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:11.769039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:11.858120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f55e699c87e440488932e69ccb3b9b0', 'request_id': 'req-f9b12a70-b92d-4804-a546-85a5f88ae0a8'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.870909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f55e699c87e440488932e69ccb3b9b0', 'request_id': 'req-f9b12a70-b92d-4804-a546-85a5f88ae0a8'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.879872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f55e699c87e440488932e69ccb3b9b0', 'request_id': 'req-f9b12a70-b92d-4804-a546-85a5f88ae0a8'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.896422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] The token cache is being invalidate because project 5f55e699c87e440488932e69ccb3b9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:11.896842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.897884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:11.904329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1236/2525] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:11 2022] DELETE /identity/v3/projects/5f55e699c87e440488932e69ccb3b9b0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:11.904500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:11.917325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6ef63-3315-40a3-bffb-79bf1781e704 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.003438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.004469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.004962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.005603 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] PATH_INFO: `/v3/users/50a36b1d57c34b95b2b50218514107b5` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.007999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a36b1d57c34b95b2b50218514107b5)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.010340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.030464 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:12.089390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a36b1d57c34b95b2b50218514107b5'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.106285 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a36b1d57c34b95b2b50218514107b5'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.107054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a36b1d57c34b95b2b50218514107b5'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.107670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a36b1d57c34b95b2b50218514107b5'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.117805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bcd113a2-c954-480a-97c4-ca3e3560df67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a36b1d57c34b95b2b50218514107b5'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.134486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1290/2526] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:11 2022] DELETE /identity/v3/users/50a36b1d57c34b95b2b50218514107b5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:12.520442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.522166 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:12.539952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12a70-b92d-4804-a546-85a5f88ae0a8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.632952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.633825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.634103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.634376 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] PATH_INFO: `/v3/projects/3738e92bfd0a4fe784ffff949278a1b2` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.635599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3738e92bfd0a4fe784ffff949278a1b2)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.637668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.713241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3738e92bfd0a4fe784ffff949278a1b2', 'request_id': 'req-eaf76168-74bb-4881-89e8-9f1f011e8181'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.725361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3738e92bfd0a4fe784ffff949278a1b2', 'request_id': 'req-eaf76168-74bb-4881-89e8-9f1f011e8181'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.735039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3738e92bfd0a4fe784ffff949278a1b2', 'request_id': 'req-eaf76168-74bb-4881-89e8-9f1f011e8181'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.739908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:12.751241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] The token cache is being invalidate because project 3738e92bfd0a4fe784ffff949278a1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:12.751970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.754390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-eaf76168-74bb-4881-89e8-9f1f011e8181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:12.758709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1237/2527] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:12 2022] DELETE /identity/v3/projects/3738e92bfd0a4fe784ffff949278a1b2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:12.765120 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65d6d-0aa2-4671-ad55-6dccf5e203b8 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.765478 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65d6d-0aa2-4671-ad55-6dccf5e203b8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.765900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf65d6d-0aa2-4671-ad55-6dccf5e203b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.793801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-abf65d6d-0aa2-4671-ad55-6dccf5e203b8 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:12.795440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-abf65d6d-0aa2-4671-ad55-6dccf5e203b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:12.867693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1291/2528] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:12.876203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948102a5-ce62-4c06-8798-eb2d1597ae97 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.876701 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948102a5-ce62-4c06-8798-eb2d1597ae97 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.876868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948102a5-ce62-4c06-8798-eb2d1597ae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.896809 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-948102a5-ce62-4c06-8798-eb2d1597ae97 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:12.898006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-948102a5-ce62-4c06-8798-eb2d1597ae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:12.910879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1238/2529] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:12.913097 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65d6d-0aa2-4671-ad55-6dccf5e203b8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.925405 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf65d6d-0aa2-4671-ad55-6dccf5e203b8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.932047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.933023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.933256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.934532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.935879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:12.936595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.938923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:12.956560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1292/2530] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:12.960315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948102a5-ce62-4c06-8798-eb2d1597ae97 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:12.971041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948102a5-ce62-4c06-8798-eb2d1597ae97 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:12.977602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:12.978277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:12.978558 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:12.978885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:12.979590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:12.981679 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.023242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1239/2531] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:12 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:13.024365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.038117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bd62-da5c-406a-b865-31319dd7b3c8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.110735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.111408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.111689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.111960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.113314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.115202 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.139375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1293/2532] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:13.143240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.159050 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c15dd4-3dbc-41f5-8372-21f134c12cfa admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.164786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.165547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.165831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.166110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.166890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.168525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.185927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1240/2533] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:13.187041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.199217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732350ba-fa9d-4b01-9475-c7b5d877e21d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.204044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b316cd-07cc-4603-9e69-e54dd8d1378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.204714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b316cd-07cc-4603-9e69-e54dd8d1378b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.204997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b316cd-07cc-4603-9e69-e54dd8d1378b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.205272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b316cd-07cc-4603-9e69-e54dd8d1378b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.206036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b316cd-07cc-4603-9e69-e54dd8d1378b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.208128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b316cd-07cc-4603-9e69-e54dd8d1378b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.210504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:13.222770 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1294/2534] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:13.225867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.236254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f41ce-f3ac-4a9e-ad68-4fa2d1a4ad38 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.241865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.242886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.243175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.243463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] PATH_INFO: `/v3/projects/9b3ab1315c9c4afcbbe1064df6feff13/users/09c90ca966d3464eb9b69f80333a3172/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.262015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3ab1315c9c4afcbbe1064df6feff13, user_id=09c90ca966d3464eb9b69f80333a3172, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.264708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.282763 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1241/2535] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:13 2022] PUT /identity/v3/projects/9b3ab1315c9c4afcbbe1064df6feff13/users/09c90ca966d3464eb9b69f80333a3172/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:13.293969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777f468-1061-4208-9c6d-945d0af28655 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.295148 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777f468-1061-4208-9c6d-945d0af28655 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.295558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777f468-1061-4208-9c6d-945d0af28655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.327058 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e777f468-1061-4208-9c6d-945d0af28655 None None] MFA Rules not processed for user `09c90ca966d3464eb9b69f80333a3172`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:13.328667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e777f468-1061-4208-9c6d-945d0af28655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:13.399940 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1295/2536] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:13.404507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.473112 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ed5fe-37fb-4e46-b61d-71364992c1e9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.483416 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.484131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.484418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.484700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.485420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.487549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.522474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1242/2537] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:13.524021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777f468-1061-4208-9c6d-945d0af28655 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.537710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777f468-1061-4208-9c6d-945d0af28655 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.604333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.605337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.605630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.606076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.606860 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.608993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.634927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1296/2538] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:13.636367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.650231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e51511-46c7-40c6-9573-a7d28200d393 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.656119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.656932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.657135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.657409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.658196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.660244 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.673867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1243/2539] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:13.678753 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.689508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa43cde-7806-481a-85fe-7c211c90cde7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.695917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244d284-ee11-46be-b860-f7aef2a1ff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.696597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d284-ee11-46be-b860-f7aef2a1ff16 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.696880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d284-ee11-46be-b860-f7aef2a1ff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.697151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244d284-ee11-46be-b860-f7aef2a1ff16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.697911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244d284-ee11-46be-b860-f7aef2a1ff16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.699662 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244d284-ee11-46be-b860-f7aef2a1ff16 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.711972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1297/2540] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:13.715273 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:13.727715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a80ea-00f6-4888-9b59-0612ef9c501e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:13.733003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:13.734006 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.734385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.734792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] PATH_INFO: `/v3/projects/0419559fe5b04ec487c11e32fb9f1f7f/users/e7a9e400c90d4d4f968972fe1717cf4b/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.752991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0419559fe5b04ec487c11e32fb9f1f7f, user_id=e7a9e400c90d4d4f968972fe1717cf4b, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:13.756501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:13.778223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1244/2541] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:13 2022] PUT /identity/v3/projects/0419559fe5b04ec487c11e32fb9f1f7f/users/e7a9e400c90d4d4f968972fe1717cf4b/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:13.789393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d546-0d6c-4dc4-9639-4c365c732bf7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:13.789697 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d546-0d6c-4dc4-9639-4c365c732bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:13.789994 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50d546-0d6c-4dc4-9639-4c365c732bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:13.827472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-4e50d546-0d6c-4dc4-9639-4c365c732bf7 None None] MFA Rules not processed for user `e7a9e400c90d4d4f968972fe1717cf4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:13.833103 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-4e50d546-0d6c-4dc4-9639-4c365c732bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:13.944521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:13.960283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1298/2542] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:13.961921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.014641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:14.043441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e5ebc-c79c-474e-b80d-c2cd6e001de9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.048818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.049700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.050054 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.050403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.051213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.053852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.093039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1245/2543] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:13 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:14.099683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50d546-0d6c-4dc4-9639-4c365c732bf7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.111442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50d546-0d6c-4dc4-9639-4c365c732bf7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.187054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.187768 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.188039 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.188314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.189022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.192262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.224496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1299/2544] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:14 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:14.230658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.247060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e50733-10ac-417c-827a-05eb15f26aee admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.283640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.284519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.288256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.288256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.288256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.288256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.299819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1246/2545] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:14.304011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.314543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8951b-66d8-46e4-bb54-bdc94717eb0f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.320083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.320966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.321256 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.321535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] PATH_INFO: `/v3/projects/a5209ab4759c46b0a4b8c937ce91a0b4/users/48950a6847314a16919e7bcc5093bc1a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.338930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5209ab4759c46b0a4b8c937ce91a0b4, user_id=48950a6847314a16919e7bcc5093bc1a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.341594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.362942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1300/2546] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:14 2022] PUT /identity/v3/projects/a5209ab4759c46b0a4b8c937ce91a0b4/users/48950a6847314a16919e7bcc5093bc1a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:14.366902 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.378598 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750b1de-99ef-4e6a-9294-e907d40ab7a9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.446425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8249b-db9d-47a2-9016-381c5b40432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.447153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8249b-db9d-47a2-9016-381c5b40432b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.447459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8249b-db9d-47a2-9016-381c5b40432b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.447889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8249b-db9d-47a2-9016-381c5b40432b admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.448633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8249b-db9d-47a2-9016-381c5b40432b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.450307 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8249b-db9d-47a2-9016-381c5b40432b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.466537 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1247/2547] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:14.467960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.494086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be4612-1982-4261-a269-41e5c4b703bf admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.498926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.499814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.500096 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.500368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] PATH_INFO: `/v3/projects/a5209ab4759c46b0a4b8c937ce91a0b4/users/48950a6847314a16919e7bcc5093bc1a/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.502641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5209ab4759c46b0a4b8c937ce91a0b4, user_id=48950a6847314a16919e7bcc5093bc1a, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.506181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.528089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1301/2548] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:14 2022] PUT /identity/v3/projects/a5209ab4759c46b0a4b8c937ce91a0b4/users/48950a6847314a16919e7bcc5093bc1a/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:28:14.533617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.534144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.534289 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.570040 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] MFA Rules not processed for user `48950a6847314a16919e7bcc5093bc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:14.571673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:14.661190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1248/2549] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:14.672848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.675539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:14.749145 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daf060-667b-4873-8e20-ea07f8828573 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.754709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.755557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.755961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.756312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.767622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.769828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.791021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1302/2550] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:14.850135 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:14.851603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:14.864853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbed65-6032-42d0-9436-a4de72ed4d16 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:14.873292 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564750a-1cd9-4afb-b8fa-4e450f7a6fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:14.874942 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564750a-1cd9-4afb-b8fa-4e450f7a6fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:14.875349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564750a-1cd9-4afb-b8fa-4e450f7a6fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:14.875968 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564750a-1cd9-4afb-b8fa-4e450f7a6fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:14.927030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:14.961302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564750a-1cd9-4afb-b8fa-4e450f7a6fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:14.963496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564750a-1cd9-4afb-b8fa-4e450f7a6fe5 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:14.974764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1249/2551] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:18.149580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:18.200773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:18.214623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eded01-c326-4dfd-850c-c767041ae634 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:18.219382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:18.220244 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:18.220524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:18.220799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] PATH_INFO: `/v3/users/09c90ca966d3464eb9b69f80333a3172` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:18.222713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c90ca966d3464eb9b69f80333a3172)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:18.224714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:18.271270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c90ca966d3464eb9b69f80333a3172'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:18.283817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c90ca966d3464eb9b69f80333a3172'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:18.284700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c90ca966d3464eb9b69f80333a3172'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:18.285341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c90ca966d3464eb9b69f80333a3172'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:18.292322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c90ca966d3464eb9b69f80333a3172'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:18.305314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1303/2552] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:18 2022] DELETE /identity/v3/users/09c90ca966d3464eb9b69f80333a3172 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:18.310369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:18.310894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:18.310995 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:18.328470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:18.329644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:18.387629 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1250/2553] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:18.397316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:18.398740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:18.458482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57ee3a-8a10-453c-ab15-9b0aef5a88f8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:18.462448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:18.463167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:18.463451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:18.463727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:18.473999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:18.475739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:18.486641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1304/2554] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:28:18.939739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:18.941198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:18.953397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25815a3a-b868-48ec-95eb-85542ce30eb6 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:18.958923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:18.959963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:18.960310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:18.960845 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] PATH_INFO: `/v3/projects/9b3ab1315c9c4afcbbe1064df6feff13` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:18.962144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3ab1315c9c4afcbbe1064df6feff13)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:18.964281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.015387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3ab1315c9c4afcbbe1064df6feff13', 'request_id': 'req-a5b2d34f-b984-4db4-8e3c-387b25e55f36'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.023867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3ab1315c9c4afcbbe1064df6feff13', 'request_id': 'req-a5b2d34f-b984-4db4-8e3c-387b25e55f36'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.030337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3ab1315c9c4afcbbe1064df6feff13', 'request_id': 'req-a5b2d34f-b984-4db4-8e3c-387b25e55f36'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.043014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] The token cache is being invalidate because project 9b3ab1315c9c4afcbbe1064df6feff13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:19.043306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.044011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.045698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1251/2555] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:18 2022] DELETE /identity/v3/projects/9b3ab1315c9c4afcbbe1064df6feff13 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:19.050529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.061001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206d806-683d-452c-88a5-3bb9d74d3c90 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.119515 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.120386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.120667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.120944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] PATH_INFO: `/v3/users/e7a9e400c90d4d4f968972fe1717cf4b` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.122119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a9e400c90d4d4f968972fe1717cf4b)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.124119 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.138746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.174157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a9e400c90d4d4f968972fe1717cf4b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.188249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a9e400c90d4d4f968972fe1717cf4b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.189006 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a9e400c90d4d4f968972fe1717cf4b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.189873 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a9e400c90d4d4f968972fe1717cf4b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.198334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a9e400c90d4d4f968972fe1717cf4b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.213504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1305/2556] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:19 2022] DELETE /identity/v3/users/e7a9e400c90d4d4f968972fe1717cf4b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:19.494987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.496433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:19.509431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d34f-b984-4db4-8e3c-387b25e55f36 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.568595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:19.575980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.577194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.577657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.577936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] PATH_INFO: `/v3/projects/0419559fe5b04ec487c11e32fb9f1f7f` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.579199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0419559fe5b04ec487c11e32fb9f1f7f)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.581681 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.629179 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0419559fe5b04ec487c11e32fb9f1f7f', 'request_id': 'req-75bd8281-77a2-4cf6-abc1-b11af56f8d91'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.636391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0419559fe5b04ec487c11e32fb9f1f7f', 'request_id': 'req-75bd8281-77a2-4cf6-abc1-b11af56f8d91'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.642443 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0419559fe5b04ec487c11e32fb9f1f7f', 'request_id': 'req-75bd8281-77a2-4cf6-abc1-b11af56f8d91'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.652865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] The token cache is being invalidate because project 0419559fe5b04ec487c11e32fb9f1f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:19.653146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.653764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.655350 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1252/2557] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:19 2022] DELETE /identity/v3/projects/0419559fe5b04ec487c11e32fb9f1f7f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:19.659834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:19.661219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:19.673776 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18c89-a0ec-402d-a04b-3d62b740588a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:19.729817 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:19.730672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:19.731053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:19.731330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] PATH_INFO: `/v3/users/48950a6847314a16919e7bcc5093bc1a` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:19.732520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48950a6847314a16919e7bcc5093bc1a)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:19.734446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:19.778927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48950a6847314a16919e7bcc5093bc1a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.792647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48950a6847314a16919e7bcc5093bc1a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.793555 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48950a6847314a16919e7bcc5093bc1a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.794179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48950a6847314a16919e7bcc5093bc1a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.806795 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-087832f1-5995-4548-8076-f3531fbc7205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48950a6847314a16919e7bcc5093bc1a'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:19.820598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1306/2558] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:19 2022] DELETE /identity/v3/users/48950a6847314a16919e7bcc5093bc1a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:20.095569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.097142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:20.110297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd8281-77a2-4cf6-abc1-b11af56f8d91 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.168257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.169109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.169387 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.169658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] PATH_INFO: `/v3/projects/a5209ab4759c46b0a4b8c937ce91a0b4` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.171041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5209ab4759c46b0a4b8c937ce91a0b4)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.172951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.219481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5209ab4759c46b0a4b8c937ce91a0b4', 'request_id': 'req-459e695f-b2e3-4667-8652-a463f2cb6bcb'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:20.226483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5209ab4759c46b0a4b8c937ce91a0b4', 'request_id': 'req-459e695f-b2e3-4667-8652-a463f2cb6bcb'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:20.232815 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5209ab4759c46b0a4b8c937ce91a0b4', 'request_id': 'req-459e695f-b2e3-4667-8652-a463f2cb6bcb'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:20.243047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] The token cache is being invalidate because project a5209ab4759c46b0a4b8c937ce91a0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:20.243336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:20.243972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-459e695f-b2e3-4667-8652-a463f2cb6bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:20.245490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1253/2559] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:20 2022] DELETE /identity/v3/projects/a5209ab4759c46b0a4b8c937ce91a0b4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:20.252274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e36d7-8cee-407f-8e08-4479bd451d4c None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.253353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e36d7-8cee-407f-8e08-4479bd451d4c None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.253353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e36d7-8cee-407f-8e08-4479bd451d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.271514 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-584e36d7-8cee-407f-8e08-4479bd451d4c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:20.272706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-584e36d7-8cee-407f-8e08-4479bd451d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:20.277903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.334878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1307/2560] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:20.343888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20a0c-eeb1-4ec3-bfa6-32484bd0f5cc None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.344260 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20a0c-eeb1-4ec3-bfa6-32484bd0f5cc None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.344577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20a0c-eeb1-4ec3-bfa6-32484bd0f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.362755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-97a20a0c-eeb1-4ec3-bfa6-32484bd0f5cc None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:20.364007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-97a20a0c-eeb1-4ec3-bfa6-32484bd0f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:20.371949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1254/2561] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:20.376146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e36d7-8cee-407f-8e08-4479bd451d4c None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.386273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e36d7-8cee-407f-8e08-4479bd451d4c None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.390972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.391618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.391904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.392179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.392898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:20.393828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.395459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.407806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1308/2562] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:20.412893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a20a0c-eeb1-4ec3-bfa6-32484bd0f5cc None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.423364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a20a0c-eeb1-4ec3-bfa6-32484bd0f5cc None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.428919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.429561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.429841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.430113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.430827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.432755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.440857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:20.461372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1255/2563] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:20 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:20.465540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.476427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70d879-95c3-4d0a-99f1-4cc91732b313 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.531642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.532351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.532636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.532914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.533601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.536171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.555867 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1309/2564] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:20 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:20.559976 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.571218 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff476-07ef-4ee8-b8d0-882c7a5983ad admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.576129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.576774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.577055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.577325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.578128 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.579871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.590337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1256/2565] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:20.594338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.604925 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd577-e534-4c66-a2eb-830339474db7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.609687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb31ce-f600-4f50-b12c-9b86bd5ee62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.610337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb31ce-f600-4f50-b12c-9b86bd5ee62d admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.610621 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb31ce-f600-4f50-b12c-9b86bd5ee62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.610930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb31ce-f600-4f50-b12c-9b86bd5ee62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.611655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb31ce-f600-4f50-b12c-9b86bd5ee62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.613234 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb31ce-f600-4f50-b12c-9b86bd5ee62d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.623099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1310/2566] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:20.627639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.637647 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43008db6-c4e9-4ee7-9e62-62ae24ccc877 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.642664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.643550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.643827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.644600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] PATH_INFO: `/v3/projects/272daf6025ae45f7a4b02e9538f8c851/users/30c7ec0a243e4a81a68586d2443fbc2b/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.658926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272daf6025ae45f7a4b02e9538f8c851, user_id=30c7ec0a243e4a81a68586d2443fbc2b, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.662174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.674868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1257/2567] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:20 2022] PUT /identity/v3/projects/272daf6025ae45f7a4b02e9538f8c851/users/30c7ec0a243e4a81a68586d2443fbc2b/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:20.687260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.687556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.687842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.714301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] MFA Rules not processed for user `30c7ec0a243e4a81a68586d2443fbc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:20.715540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:20.785720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1311/2568] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:20.797339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:20.799072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:20.863058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd722bc-76bb-4983-947a-8ae67a393423 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:20.866813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734920f-107a-406c-a55e-0decb5a0ed73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40a1f11c5cd4b48be27dd1a0f48bdc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:20.867456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734920f-107a-406c-a55e-0decb5a0ed73 service glance] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:20.867738 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734920f-107a-406c-a55e-0decb5a0ed73 service glance] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:20.868014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734920f-107a-406c-a55e-0decb5a0ed73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:20.876326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734920f-107a-406c-a55e-0decb5a0ed73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:20.877773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734920f-107a-406c-a55e-0decb5a0ed73 service glance] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:20.887183 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1258/2569] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:28:23.120109 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:23.122022 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:23.132312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:23.183183 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9f711-e752-4490-a426-f7037acc2b0d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:23.186875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:23.187620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:23.187912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:23.188270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:23.190408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:23.201626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:23.203117 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:23.211725 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1312/2570] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:25.389698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b06a2-e351-4db3-a03f-e522c232b4c3 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.390206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b06a2-e351-4db3-a03f-e522c232b4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.390326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b06a2-e351-4db3-a03f-e522c232b4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.407364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-746b06a2-e351-4db3-a03f-e522c232b4c3 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:25.408563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-746b06a2-e351-4db3-a03f-e522c232b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:25.467655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1259/2571] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 30 10:28:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:25.480150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:25.481535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:25.558237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0527b9-88cb-480c-9fde-338ed689b3aa service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:25.563670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:25.564332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:25.564642 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:25.564921 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:25.574011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:25.575665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:25.584013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1313/2572] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:28:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:28:35.460840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:35.580495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=55 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:45.704408 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.704997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.704997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.724280 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:45.725480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:45.733102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1260/2573] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 30 10:28:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:45.746367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:45.756912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf301-3c17-4d91-8544-2114810d4827 service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:45.762048 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:45.762715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:45.763001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:45.763390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:45.771654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:45.773260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:45.781484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1314/2574] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:28:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:28:48.357559 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:48.359043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:48.370395 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c77c7-702e-4505-a424-51bf4b3a7d22 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:48.374167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:48.374877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:48.375161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:48.375439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:48.377147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:48.441105 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:48.442541 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:48.452601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1261/2575] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:54.302666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:54.313372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0638b-425b-42eb-b9e7-6f092195180f service swift] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:54.317063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90141c4-b8fd-42ad-9229-62f6583d07f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:54.317702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90141c4-b8fd-42ad-9229-62f6583d07f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:54.318324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90141c4-b8fd-42ad-9229-62f6583d07f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:54.318799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90141c4-b8fd-42ad-9229-62f6583d07f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:54.320928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c90141c4-b8fd-42ad-9229-62f6583d07f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:54.389489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90141c4-b8fd-42ad-9229-62f6583d07f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:54.390971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90141c4-b8fd-42ad-9229-62f6583d07f6 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:54.401324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1315/2576] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:28:55.413913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:55.424996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465893e-512f-4e6c-bc0d-5b30f9223265 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:55.429481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:55.431140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.431427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.431700 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] PATH_INFO: `/v3/users/30c7ec0a243e4a81a68586d2443fbc2b` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.432904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c7ec0a243e4a81a68586d2443fbc2b)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:55.434874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:55.485227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c7ec0a243e4a81a68586d2443fbc2b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:55.501097 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c7ec0a243e4a81a68586d2443fbc2b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:55.501806 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c7ec0a243e4a81a68586d2443fbc2b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:55.502419 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c7ec0a243e4a81a68586d2443fbc2b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:55.509503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c7ec0a243e4a81a68586d2443fbc2b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:55.522557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1262/2577] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:55 2022] DELETE /identity/v3/users/30c7ec0a243e4a81a68586d2443fbc2b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:55.527924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.528499 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.528781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.548186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:55.549305 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:55.623647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1316/2578] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:28:55.634036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:55.635685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:55.708557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2dbbf-1623-43ec-bf94-0d798ebb9cd9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:55.713047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c067c-a9e6-46a3-9da5-6e037a812583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:55.713715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c067c-a9e6-46a3-9da5-6e037a812583 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:55.714001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c067c-a9e6-46a3-9da5-6e037a812583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:55.714282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c067c-a9e6-46a3-9da5-6e037a812583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:55.724619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c067c-a9e6-46a3-9da5-6e037a812583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:55.726084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c067c-a9e6-46a3-9da5-6e037a812583 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:55.737863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1263/2579] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:56.136981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.138816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:56.152115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e503a-5200-4b45-8d14-7a33bd218619 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.157731 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.158863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.159226 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.159577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] PATH_INFO: `/v3/projects/272daf6025ae45f7a4b02e9538f8c851` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.161165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] RBAC: Authorizing `identity:delete_project(project_id=272daf6025ae45f7a4b02e9538f8c851)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.163385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.226440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272daf6025ae45f7a4b02e9538f8c851', 'request_id': 'req-1087aa67-3094-4641-9ad8-dd9cb425972d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:56.236560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272daf6025ae45f7a4b02e9538f8c851', 'request_id': 'req-1087aa67-3094-4641-9ad8-dd9cb425972d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:56.244414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272daf6025ae45f7a4b02e9538f8c851', 'request_id': 'req-1087aa67-3094-4641-9ad8-dd9cb425972d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:56.255727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] The token cache is being invalidate because project 272daf6025ae45f7a4b02e9538f8c851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:28:56.256021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:56.256683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1087aa67-3094-4641-9ad8-dd9cb425972d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:56.258323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1317/2580] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:28:56 2022] DELETE /identity/v3/projects/272daf6025ae45f7a4b02e9538f8c851 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:56.263306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c17b2-c6d4-4700-a813-137e9138978a None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.263603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c17b2-c6d4-4700-a813-137e9138978a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.263886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c17b2-c6d4-4700-a813-137e9138978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.279695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:56.291769 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-491c17b2-c6d4-4700-a813-137e9138978a None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:56.293989 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-491c17b2-c6d4-4700-a813-137e9138978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:56.364812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1264/2581] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:56.372268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfb6b8-7ef4-4311-bbbf-d40800bc1b6e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.372565 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfb6b8-7ef4-4311-bbbf-d40800bc1b6e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.372850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfb6b8-7ef4-4311-bbbf-d40800bc1b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.381834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:56.394380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-20dfb6b8-7ef4-4311-bbbf-d40800bc1b6e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:56.396453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-20dfb6b8-7ef4-4311-bbbf-d40800bc1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:56.408970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1318/2582] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:56.410160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c17b2-c6d4-4700-a813-137e9138978a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.421698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c17b2-c6d4-4700-a813-137e9138978a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.426654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.427428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.427773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.428216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.429230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:28:56.429548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.431246 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.443961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1265/2583] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:28:56.448540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfb6b8-7ef4-4311-bbbf-d40800bc1b6e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.459743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfb6b8-7ef4-4311-bbbf-d40800bc1b6e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.467269 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.468175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.468458 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.468737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.469438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.471396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.509516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1319/2584] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:28:56 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:28:56.513678 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.524877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8d1d2-124d-469e-a8ca-0960014ef2a5 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.598257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.598917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.599201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.599475 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.600627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.602983 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.627564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1266/2585] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:28:56 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:28:56.631701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.646898 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240b8d-f840-4f40-9234-451ac629ba1e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.653866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.654548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.654874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.655153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.656034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.660523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.674775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1320/2586] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:28:56.676116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.688694 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a30fe2-dbab-4957-96ec-a19ebaaa9966 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.694296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f502b-909b-4c1d-8344-a959ebd3b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.695013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f502b-909b-4c1d-8344-a959ebd3b098 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.695296 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f502b-909b-4c1d-8344-a959ebd3b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.695577 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f502b-909b-4c1d-8344-a959ebd3b098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.696841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f502b-909b-4c1d-8344-a959ebd3b098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.698461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f502b-909b-4c1d-8344-a959ebd3b098 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.714335 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1267/2587] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:28:56.716241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.729283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62059fb-0878-443f-a409-88520976bffe admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:56.733281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:56.734289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.734668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.735087 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] PATH_INFO: `/v3/projects/189e1cbf45124e7f94d5bc7d7560519a/users/2f7f328dcc3b4936bfaf6cd27a80fdd9/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.751106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189e1cbf45124e7f94d5bc7d7560519a, user_id=2f7f328dcc3b4936bfaf6cd27a80fdd9, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:56.753883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:56.771210 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1321/2588] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:28:56 2022] PUT /identity/v3/projects/189e1cbf45124e7f94d5bc7d7560519a/users/2f7f328dcc3b4936bfaf6cd27a80fdd9/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:28:56.782814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:56.782814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:56.783263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:56.818515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] MFA Rules not processed for user `2f7f328dcc3b4936bfaf6cd27a80fdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:28:56.822744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:56.898328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1268/2589] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:28:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:28:56.909211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:56.911303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:57.005971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030c655-ed47-4ca1-9cce-19fa73264502 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:57.010455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:57.011132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:57.011418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:57.011695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:57.020249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:57.021677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:57.034659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1322/2590] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:58.268928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:58.270483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:58.279385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:58.385504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30469529-70bf-49b4-8c25-ab144f612766 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:58.394881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee6e34-ee50-4669-b9c7-40df1ecc2bd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:58.395979 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee6e34-ee50-4669-b9c7-40df1ecc2bd8 service placement] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:58.396378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee6e34-ee50-4669-b9c7-40df1ecc2bd8 service placement] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:58.396707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee6e34-ee50-4669-b9c7-40df1ecc2bd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:58.398640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6cee6e34-ee50-4669-b9c7-40df1ecc2bd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:28:58.416141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee6e34-ee50-4669-b9c7-40df1ecc2bd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:58.417787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee6e34-ee50-4669-b9c7-40df1ecc2bd8 service placement] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:58.431990 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1269/2591] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:28:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:28:59.781968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:28:59.864351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9c867-41ee-4bef-af8d-1198341a1555 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:28:59.869730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:28:59.870746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:28:59.871074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:28:59.871419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] PATH_INFO: `/v3/users/2f7f328dcc3b4936bfaf6cd27a80fdd9` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:28:59.872724 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7f328dcc3b4936bfaf6cd27a80fdd9)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:28:59.874904 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:28:59.942809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7f328dcc3b4936bfaf6cd27a80fdd9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:59.944537 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:28:59.977043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7f328dcc3b4936bfaf6cd27a80fdd9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:59.978054 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7f328dcc3b4936bfaf6cd27a80fdd9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:59.978799 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7f328dcc3b4936bfaf6cd27a80fdd9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:28:59.988113 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7f328dcc3b4936bfaf6cd27a80fdd9'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:00.011889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1323/2592] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:28:59 2022] DELETE /identity/v3/users/2f7f328dcc3b4936bfaf6cd27a80fdd9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:00.015057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:00.015587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:00.015698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:00.043378 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:00.046622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:00.151453 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1270/2593] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:00.175693 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:00.177314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:00.284591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3377e16-4d41-4120-a689-30c721a3fba8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:00.291287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:00.292219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:00.293137 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:00.293632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:00.319282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:00.324450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:00.345438 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1324/2594] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:29:01.299458 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:01.301049 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:01.316527 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b3ca6-2b80-4fcf-8bf6-82b0a006e85f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:01.329316 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:01.330216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:01.330497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:01.330787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] PATH_INFO: `/v3/projects/189e1cbf45124e7f94d5bc7d7560519a` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:01.332224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189e1cbf45124e7f94d5bc7d7560519a)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:01.334315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:01.400663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189e1cbf45124e7f94d5bc7d7560519a', 'request_id': 'req-7b87a54f-32a8-4818-bbbe-9d98c3538358'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:01.408286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189e1cbf45124e7f94d5bc7d7560519a', 'request_id': 'req-7b87a54f-32a8-4818-bbbe-9d98c3538358'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:01.415615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189e1cbf45124e7f94d5bc7d7560519a', 'request_id': 'req-7b87a54f-32a8-4818-bbbe-9d98c3538358'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:01.428072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] The token cache is being invalidate because project 189e1cbf45124e7f94d5bc7d7560519a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:01.428432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:01.429157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:01.439605 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1271/2595] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:01 2022] DELETE /identity/v3/projects/189e1cbf45124e7f94d5bc7d7560519a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:02.225824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:02.227466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:02.292317 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:02.293814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:02.304046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89429c-3510-44f1-9b41-f828d6f951c7 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:02.316613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:02.369531 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87a54f-32a8-4818-bbbe-9d98c3538358 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:02.375057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:02.375722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:02.375959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:02.376380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:02.376509 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:02.376678 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:02.376802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] PATH_INFO: `/v3/users/87836624f7254574b5404fef6cf55d26` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:02.376968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:02.378015 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87836624f7254574b5404fef6cf55d26)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:02.388333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:02.391579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:02.400670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:02.402249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:02.407213 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:02.416486 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1325/2596] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:02.457695 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87836624f7254574b5404fef6cf55d26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.470430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87836624f7254574b5404fef6cf55d26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.471153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87836624f7254574b5404fef6cf55d26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.471796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87836624f7254574b5404fef6cf55d26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.483826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87836624f7254574b5404fef6cf55d26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.499726 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1272/2597] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:02 2022] DELETE /identity/v3/users/87836624f7254574b5404fef6cf55d26 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:02.685619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:02.698482 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d2ef-ea9b-4449-afe9-52ed6fc8b233 service placement] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:02.760432 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:02.761384 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:02.761730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:02.762027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] PATH_INFO: `/v3/projects/28124a417dc443aca95f3edd11697c05` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:02.763385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28124a417dc443aca95f3edd11697c05)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:02.765504 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:02.814902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28124a417dc443aca95f3edd11697c05', 'request_id': 'req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.824592 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28124a417dc443aca95f3edd11697c05', 'request_id': 'req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.830887 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28124a417dc443aca95f3edd11697c05', 'request_id': 'req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.842824 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] The token cache is being invalidate because project 28124a417dc443aca95f3edd11697c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:02.843203 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.843920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.845701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1326/2598] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:02 2022] DELETE /identity/v3/projects/28124a417dc443aca95f3edd11697c05 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:02.849768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:02.851285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:02.864354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cac0e-ad07-4366-8da7-2049ab76df9d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:02.924240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:02.925126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:02.925409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:02.925691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] PATH_INFO: `/v3/users/5a99a886ea9c4f1ba2cebba65f3c8e51` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:02.926964 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a99a886ea9c4f1ba2cebba65f3c8e51)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:02.928904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:02.968834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:02.978107 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a99a886ea9c4f1ba2cebba65f3c8e51'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.990083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a99a886ea9c4f1ba2cebba65f3c8e51'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.990811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a99a886ea9c4f1ba2cebba65f3c8e51'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.991406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a99a886ea9c4f1ba2cebba65f3c8e51'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:02.998607 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a99a886ea9c4f1ba2cebba65f3c8e51'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:03.011620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1273/2599] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:02 2022] DELETE /identity/v3/users/5a99a886ea9c4f1ba2cebba65f3c8e51 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:03.182635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:03.184312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:03.202191 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc9c53-1dd5-4dbc-a79c-b02ee23bd914 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:03.260667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:03.261559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:03.261845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:03.262122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] PATH_INFO: `/v3/projects/7b5415d0216f4b5ebdd77ba78c162297` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:03.263343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5415d0216f4b5ebdd77ba78c162297)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:03.265276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:03.297890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:03.313764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5415d0216f4b5ebdd77ba78c162297', 'request_id': 'req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:03.321999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5415d0216f4b5ebdd77ba78c162297', 'request_id': 'req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:03.328304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5415d0216f4b5ebdd77ba78c162297', 'request_id': 'req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:03.338971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] The token cache is being invalidate because project 7b5415d0216f4b5ebdd77ba78c162297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:03.339262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:03.339924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:03.341783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1327/2600] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:03 2022] DELETE /identity/v3/projects/7b5415d0216f4b5ebdd77ba78c162297 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:29:04.933057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:04.934457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:04.990087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657671f-8223-492e-b620-f58ae668c0e9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:05.036503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:05.037139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:05.037421 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:05.037691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:05.039996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:05.100256 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:05.102157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:05.114886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1274/2601] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:08.229568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:08.231262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:08.246918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b620d-a74e-4dd6-bc93-ca98c50b9ffa admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:08.251973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:08.252863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.253144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.253417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] PATH_INFO: `/v3/users/ecf6ed97c0eb4db68cf951044ce9ff2d` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:08.254598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf6ed97c0eb4db68cf951044ce9ff2d)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:08.256525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:08.302387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf6ed97c0eb4db68cf951044ce9ff2d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.315595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf6ed97c0eb4db68cf951044ce9ff2d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.316263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf6ed97c0eb4db68cf951044ce9ff2d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.316856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf6ed97c0eb4db68cf951044ce9ff2d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.323854 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-9937ebc3-3277-4238-b8b6-e75071c27c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf6ed97c0eb4db68cf951044ce9ff2d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.336712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1328/2602] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:08 2022] DELETE /identity/v3/users/ecf6ed97c0eb4db68cf951044ce9ff2d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:08.515420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:08.526190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69633531-7cbd-4559-9651-e51a832c114a service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:08.547677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:08.588756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:08.589688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.589971 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.590245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] PATH_INFO: `/v3/projects/d85406a94e3c4b07852c8d61bdcfc79e` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:08.591436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85406a94e3c4b07852c8d61bdcfc79e)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:08.593331 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:08.640069 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85406a94e3c4b07852c8d61bdcfc79e', 'request_id': 'req-1414729a-cb89-430d-ae48-29bb9d67f48b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.646789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85406a94e3c4b07852c8d61bdcfc79e', 'request_id': 'req-1414729a-cb89-430d-ae48-29bb9d67f48b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.653917 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85406a94e3c4b07852c8d61bdcfc79e', 'request_id': 'req-1414729a-cb89-430d-ae48-29bb9d67f48b'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.664301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] The token cache is being invalidate because project d85406a94e3c4b07852c8d61bdcfc79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:08.664588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.665214 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1414729a-cb89-430d-ae48-29bb9d67f48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:08.666842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1275/2603] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:08 2022] DELETE /identity/v3/projects/d85406a94e3c4b07852c8d61bdcfc79e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:08.672517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049767-adba-42d0-8d63-066391737a8d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.672806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049767-adba-42d0-8d63-066391737a8d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.673084 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049767-adba-42d0-8d63-066391737a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:08.690910 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e2049767-adba-42d0-8d63-066391737a8d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:08.692106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e2049767-adba-42d0-8d63-066391737a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:08.750760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1329/2604] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:08.759053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715323b-0d4e-4b3b-9274-494c97c7c2a7 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.759401 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715323b-0d4e-4b3b-9274-494c97c7c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.759682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715323b-0d4e-4b3b-9274-494c97c7c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:08.778556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-a715323b-0d4e-4b3b-9274-494c97c7c2a7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:08.779787 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-a715323b-0d4e-4b3b-9274-494c97c7c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:08.788033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1276/2605] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:08.792325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2049767-adba-42d0-8d63-066391737a8d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:08.801903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2049767-adba-42d0-8d63-066391737a8d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:08.806560 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:08.807252 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.807534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.807810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:08.808531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:08.808839 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:08.810434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:08.823573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1330/2606] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:08.827643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715323b-0d4e-4b3b-9274-494c97c7c2a7 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:08.837736 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715323b-0d4e-4b3b-9274-494c97c7c2a7 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:08.842889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:08.843550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.843832 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.844109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:08.844810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:08.846757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:08.876245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1277/2607] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:08 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:29:08.880386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:08.891102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20485a0b-3089-4e8a-b98a-323b2830032d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:08.904477 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:08.953290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:08.953960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.954246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.954521 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:08.955259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:08.957162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:08.978098 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1331/2608] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:08 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:08.982234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:08.993980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b6ada-2d77-4f0d-b21d-fa2b56d22577 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:08.998609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:08.999290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:08.999570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:08.999841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.000556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.002231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.013424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1278/2609] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:09.017317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.027260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68299e4b-4ae7-4a47-a5cc-68bdf6336b4c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.031845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5bc6b-a70a-453f-91e1-56c8362c8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.032489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5bc6b-a70a-453f-91e1-56c8362c8ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.032767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5bc6b-a70a-453f-91e1-56c8362c8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.033066 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5bc6b-a70a-453f-91e1-56c8362c8ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.033782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5bc6b-a70a-453f-91e1-56c8362c8ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.035407 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5bc6b-a70a-453f-91e1-56c8362c8ea2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.045660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1332/2610] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:09.049633 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.060031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444f6e-0b02-480a-9a7f-e47707e66543 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.064692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.065552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.065834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.066106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] PATH_INFO: `/v3/projects/4df32cd0ca2743cbab0e6b29fe1b9711/users/d7f97e20e661482caeabca263487eb23/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.081581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df32cd0ca2743cbab0e6b29fe1b9711, user_id=d7f97e20e661482caeabca263487eb23, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.084364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.096985 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1279/2611] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:09 2022] PUT /identity/v3/projects/4df32cd0ca2743cbab0e6b29fe1b9711/users/d7f97e20e661482caeabca263487eb23/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:09.107762 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46a874-7833-43fd-8184-e4b41b02f759 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.108081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46a874-7833-43fd-8184-e4b41b02f759 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.108356 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46a874-7833-43fd-8184-e4b41b02f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.136036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ad46a874-7833-43fd-8184-e4b41b02f759 None None] MFA Rules not processed for user `d7f97e20e661482caeabca263487eb23`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:09.137297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ad46a874-7833-43fd-8184-e4b41b02f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:09.203416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1333/2612] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:09.208027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.255324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.272188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facdd1c-43fa-4b27-ab43-f396055fdeb6 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.276935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.277585 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.277996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.278275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.279002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.280903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.307205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1280/2613] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:09 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:09.311689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46a874-7833-43fd-8184-e4b41b02f759 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.323409 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46a874-7833-43fd-8184-e4b41b02f759 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.378983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.379645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.379928 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.380211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.380902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.382857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.402292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1334/2614] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:09 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:09.406449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.417786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731386-9d66-4827-afe0-615018f262b0 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.422831 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.423491 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.423773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.424048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.424772 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.426365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.437456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1281/2615] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:09.442001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.453943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3ced8-695c-403c-90f7-7259529abb61 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.459523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.460455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.460788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.461154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] PATH_INFO: `/v3/projects/7a5e252f203241588cd1473af50e03fa/users/0c2c7db3639d448683d341fe1f66c431/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.474164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.482235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5e252f203241588cd1473af50e03fa, user_id=0c2c7db3639d448683d341fe1f66c431, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.484962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.499626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1335/2616] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:09 2022] PUT /identity/v3/projects/7a5e252f203241588cd1473af50e03fa/users/0c2c7db3639d448683d341fe1f66c431/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:09.503612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.513687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3545-73ec-438a-9fd2-c87631aa3ed8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.572388 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75c4f0-ae11-443b-90a7-009b057e52ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.573192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75c4f0-ae11-443b-90a7-009b057e52ed admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.573483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75c4f0-ae11-443b-90a7-009b057e52ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.573759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75c4f0-ae11-443b-90a7-009b057e52ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.574484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75c4f0-ae11-443b-90a7-009b057e52ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.576186 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75c4f0-ae11-443b-90a7-009b057e52ed admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.588358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1282/2617] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:09.592601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.602759 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d37cd2-cd98-4ab7-9579-681f61a44f90 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.607430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.608296 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.608580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.608855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] PATH_INFO: `/v3/projects/7a5e252f203241588cd1473af50e03fa/users/0c2c7db3639d448683d341fe1f66c431/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.610862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5e252f203241588cd1473af50e03fa, user_id=0c2c7db3639d448683d341fe1f66c431, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.613471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.623846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1336/2618] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:09 2022] PUT /identity/v3/projects/7a5e252f203241588cd1473af50e03fa/users/0c2c7db3639d448683d341fe1f66c431/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:09.633816 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.634164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.634444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.662034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] MFA Rules not processed for user `0c2c7db3639d448683d341fe1f66c431`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:09.663297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:09.733784 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1283/2619] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:09.746043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.747793 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:09.806029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053dc8f-201e-494f-baff-2bb49e3bc32e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.809694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.810346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.810633 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.810946 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.821377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.822851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.832375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1337/2620] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:09.875180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:09.876566 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:09.889001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b0bb9-75f1-4430-a698-a43abe13a630 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:09.892646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe261a4-1022-4d13-9d98-54d119a2517d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:09.893278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe261a4-1022-4d13-9d98-54d119a2517d service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:09.893561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe261a4-1022-4d13-9d98-54d119a2517d service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:09.893836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe261a4-1022-4d13-9d98-54d119a2517d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:09.933142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:09.952063 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe261a4-1022-4d13-9d98-54d119a2517d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:09.953542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe261a4-1022-4d13-9d98-54d119a2517d service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:09.962621 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1284/2621] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:13.249718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:13.311958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49bacc-5555-42ff-ae54-99eda7cfb7b8 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:13.317034 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:13.317923 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:13.318240 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:13.318599 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] PATH_INFO: `/v3/users/d7f97e20e661482caeabca263487eb23` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:13.319809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f97e20e661482caeabca263487eb23)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:13.322299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:13.367649 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f97e20e661482caeabca263487eb23'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.379579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f97e20e661482caeabca263487eb23'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.380243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f97e20e661482caeabca263487eb23'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.380853 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f97e20e661482caeabca263487eb23'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.388169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f97e20e661482caeabca263487eb23'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.396658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:13.402426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1338/2622] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:13 2022] DELETE /identity/v3/users/d7f97e20e661482caeabca263487eb23 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:13.407142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:13.407622 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:13.407725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:13.424639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:13.425842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:13.484155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1285/2623] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:13.494469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:13.495909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:13.552856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed115d4-2ae2-44bb-93b9-b986eaf7176e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:13.557159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:13.557791 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:13.558076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:13.558353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:13.567360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:13.568729 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:13.579144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1339/2624] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:13.844036 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:13.845874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:13.859846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658648d-88d1-4502-b020-9df09dcbc4e4 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:13.864912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:13.865773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:13.866077 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:13.866341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] PATH_INFO: `/v3/projects/4df32cd0ca2743cbab0e6b29fe1b9711` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:13.868184 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df32cd0ca2743cbab0e6b29fe1b9711)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:13.871198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:13.918047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df32cd0ca2743cbab0e6b29fe1b9711', 'request_id': 'req-13a8f9de-9313-4165-ab9b-4c654e1db41c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.925293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df32cd0ca2743cbab0e6b29fe1b9711', 'request_id': 'req-13a8f9de-9313-4165-ab9b-4c654e1db41c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.932196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df32cd0ca2743cbab0e6b29fe1b9711', 'request_id': 'req-13a8f9de-9313-4165-ab9b-4c654e1db41c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.942365 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] The token cache is being invalidate because project 4df32cd0ca2743cbab0e6b29fe1b9711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:13.942657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.943333 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:13.945120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1286/2625] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:13 2022] DELETE /identity/v3/projects/4df32cd0ca2743cbab0e6b29fe1b9711 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:13.949367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:13.958979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d871b2-789f-454f-876f-faee20ef59c8 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.017658 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.018520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.018842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.019122 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] PATH_INFO: `/v3/users/0c2c7db3639d448683d341fe1f66c431` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.020312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2c7db3639d448683d341fe1f66c431)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.022249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.068608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2c7db3639d448683d341fe1f66c431'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.081969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2c7db3639d448683d341fe1f66c431'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.082609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2c7db3639d448683d341fe1f66c431'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.083237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2c7db3639d448683d341fe1f66c431'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.089916 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-c17887d8-2c9c-45dc-a80c-cf8f3ac2bf36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2c7db3639d448683d341fe1f66c431'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.102956 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1340/2626] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:13 2022] DELETE /identity/v3/users/0c2c7db3639d448683d341fe1f66c431 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:14.370470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:14.372167 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:14.385271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f9de-9313-4165-ab9b-4c654e1db41c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.443140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.443986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.444272 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.444548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] PATH_INFO: `/v3/projects/7a5e252f203241588cd1473af50e03fa` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.445752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a5e252f203241588cd1473af50e03fa)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.447711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.454155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:14.497103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a5e252f203241588cd1473af50e03fa', 'request_id': 'req-86781663-388e-4339-b174-fc8ba51c65fb'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.504632 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a5e252f203241588cd1473af50e03fa', 'request_id': 'req-86781663-388e-4339-b174-fc8ba51c65fb'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.511372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a5e252f203241588cd1473af50e03fa', 'request_id': 'req-86781663-388e-4339-b174-fc8ba51c65fb'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.522002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] The token cache is being invalidate because project 7a5e252f203241588cd1473af50e03fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:14.522287 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.522955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-86781663-388e-4339-b174-fc8ba51c65fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:14.525192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1287/2627] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:14 2022] DELETE /identity/v3/projects/7a5e252f203241588cd1473af50e03fa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:14.530222 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b728-5088-432a-b3e3-5759d409d3a3 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.530713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b728-5088-432a-b3e3-5759d409d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.530844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b728-5088-432a-b3e3-5759d409d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.549085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-fdd2b728-5088-432a-b3e3-5759d409d3a3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:14.550300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-fdd2b728-5088-432a-b3e3-5759d409d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:14.567155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:14.610964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1341/2628] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:14.619992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0016eb-3f12-47e0-b3d2-a4d258b7ad37 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.620240 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0016eb-3f12-47e0-b3d2-a4d258b7ad37 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.620519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0016eb-3f12-47e0-b3d2-a4d258b7ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.639129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-7a0016eb-3f12-47e0-b3d2-a4d258b7ad37 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:14.640326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7a0016eb-3f12-47e0-b3d2-a4d258b7ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:14.649187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1288/2629] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:14.653554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2b728-5088-432a-b3e3-5759d409d3a3 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:14.663390 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2b728-5088-432a-b3e3-5759d409d3a3 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.668085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.668728 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.669011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.669289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.670003 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:14.670312 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.671937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.683732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1342/2630] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:14.687786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0016eb-3f12-47e0-b3d2-a4d258b7ad37 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:14.697877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0016eb-3f12-47e0-b3d2-a4d258b7ad37 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.702907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.703546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.703825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.704098 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.704782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.706775 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.732067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1289/2631] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:14 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:14.736088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:14.745919 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c920d0-2355-4b61-8954-0854bd67a04b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.802920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.803630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.803958 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.804157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.804944 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.806801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.827741 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1343/2632] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:14 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:29:14.831926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:14.842921 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df6fa1-aa9d-4b8a-802f-b4c0c1ebe690 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.847806 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.848460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.848745 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.849026 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.849747 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.851414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.861796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1290/2633] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:14.865635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:14.875682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00951a1a-1982-4c97-8b8e-2079493bcfe5 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.880254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc604b-f7ff-4811-85d7-7f8ced1b3ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.880908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc604b-f7ff-4811-85d7-7f8ced1b3ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.881198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc604b-f7ff-4811-85d7-7f8ced1b3ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.881480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc604b-f7ff-4811-85d7-7f8ced1b3ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.882204 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc604b-f7ff-4811-85d7-7f8ced1b3ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.884393 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc604b-f7ff-4811-85d7-7f8ced1b3ac1 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.894087 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1344/2634] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:14.897920 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:14.908496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f377ff-e6d0-4147-b654-78cf9ed319a9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:14.913180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:14.914052 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.914339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.914619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] PATH_INFO: `/v3/projects/aa9cc6f7ee9647d28cbb7b03c8fbdd1a/users/8a9f5655f5d34b12a144bf571639d0e4/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.928953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9cc6f7ee9647d28cbb7b03c8fbdd1a, user_id=8a9f5655f5d34b12a144bf571639d0e4, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:14.931662 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:14.946037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1291/2635] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:14 2022] PUT /identity/v3/projects/aa9cc6f7ee9647d28cbb7b03c8fbdd1a/users/8a9f5655f5d34b12a144bf571639d0e4/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:14.956116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca126e-ee97-428f-a750-8dbefc3d5a08 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:14.956403 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca126e-ee97-428f-a750-8dbefc3d5a08 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:14.956704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca126e-ee97-428f-a750-8dbefc3d5a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:14.983415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-c4ca126e-ee97-428f-a750-8dbefc3d5a08 None None] MFA Rules not processed for user `8a9f5655f5d34b12a144bf571639d0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:14.984647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-c4ca126e-ee97-428f-a750-8dbefc3d5a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:15.048814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1345/2636] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:15.053203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.118866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62cbfc-63a0-4ebc-975c-841c6e12e6c2 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.123472 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.124121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.124405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.124682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.125364 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.127357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.152878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1292/2637] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:15 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:15.158323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca126e-ee97-428f-a750-8dbefc3d5a08 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.173942 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca126e-ee97-428f-a750-8dbefc3d5a08 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.186696 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:15.240050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.240733 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.241012 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.241289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.241978 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.244536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.264369 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1346/2638] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:15 2022] POST /identity/v3/users => generated 306 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:15.268234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.278770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558893f0-11da-436b-90e8-d73798dfa545 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.283277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.283924 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.284201 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.284474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.285192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.286813 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.298143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1293/2639] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:15.302554 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.313249 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d36c-089d-4d19-96fb-66811085e8ae admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.317890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.318803 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.319090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.319367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] PATH_INFO: `/v3/projects/e25f03426b674b18a696980733c2ca96/users/5e33aab56d9c4385b3e5ed31d2e02b75/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.334572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25f03426b674b18a696980733c2ca96, user_id=5e33aab56d9c4385b3e5ed31d2e02b75, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.337420 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.349890 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1347/2640] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:15 2022] PUT /identity/v3/projects/e25f03426b674b18a696980733c2ca96/users/5e33aab56d9c4385b3e5ed31d2e02b75/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:15.354437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.362003 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:15.365862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25056a1-784b-4243-8cfa-02b3bee8cd36 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.422922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54205417-426b-4123-adf2-fe450b2bee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.423588 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205417-426b-4123-adf2-fe450b2bee50 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.423869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205417-426b-4123-adf2-fe450b2bee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.424143 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205417-426b-4123-adf2-fe450b2bee50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.424865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54205417-426b-4123-adf2-fe450b2bee50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.426526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54205417-426b-4123-adf2-fe450b2bee50 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.436887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1294/2641] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:15.440986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.451713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6c731-4e95-4e01-9262-788866f9c608 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.456426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.457298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.457583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.457861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] PATH_INFO: `/v3/projects/e25f03426b674b18a696980733c2ca96/users/5e33aab56d9c4385b3e5ed31d2e02b75/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.459905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25f03426b674b18a696980733c2ca96, user_id=5e33aab56d9c4385b3e5ed31d2e02b75, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.462726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.472868 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1348/2642] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:15 2022] PUT /identity/v3/projects/e25f03426b674b18a696980733c2ca96/users/5e33aab56d9c4385b3e5ed31d2e02b75/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:15.483601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373f63a-74b4-4d2b-bddc-eeb7db82a16a None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.484115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373f63a-74b4-4d2b-bddc-eeb7db82a16a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.484223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373f63a-74b4-4d2b-bddc-eeb7db82a16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.512046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3373f63a-74b4-4d2b-bddc-eeb7db82a16a None None] MFA Rules not processed for user `5e33aab56d9c4385b3e5ed31d2e02b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:15.513255 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3373f63a-74b4-4d2b-bddc-eeb7db82a16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:15.581829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1295/2643] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:15.592430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.594184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:15.652579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c85be7-a26e-49ff-b13a-e0046e41d811 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.656265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.656908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.657193 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.657472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.667061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.668490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.677892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1349/2644] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:15.749058 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373f63a-74b4-4d2b-bddc-eeb7db82a16a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:15.758722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373f63a-74b4-4d2b-bddc-eeb7db82a16a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:15.762449 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03585b66-0cb7-48da-93c6-2c9378cd9a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:15.763121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03585b66-0cb7-48da-93c6-2c9378cd9a17 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:15.763405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03585b66-0cb7-48da-93c6-2c9378cd9a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:15.763683 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03585b66-0cb7-48da-93c6-2c9378cd9a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:15.819949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03585b66-0cb7-48da-93c6-2c9378cd9a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:15.821469 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03585b66-0cb7-48da-93c6-2c9378cd9a17 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:15.830609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1296/2645] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:19.866639 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:19.929813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5b667-5c17-405e-a52c-70ab950e8325 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:19.935845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:19.936707 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:19.936989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:19.937265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] PATH_INFO: `/v3/users/8a9f5655f5d34b12a144bf571639d0e4` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:19.938443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9f5655f5d34b12a144bf571639d0e4)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:19.940549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:19.954712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:19.988970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9f5655f5d34b12a144bf571639d0e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.001425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9f5655f5d34b12a144bf571639d0e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.002102 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9f5655f5d34b12a144bf571639d0e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.002777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9f5655f5d34b12a144bf571639d0e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.009583 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9f5655f5d34b12a144bf571639d0e4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.022001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1350/2646] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:19 2022] DELETE /identity/v3/users/8a9f5655f5d34b12a144bf571639d0e4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:20.026565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:20.027099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:20.027206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:20.044418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:20.045556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:20.065060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:20.105661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1297/2647] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:20.115251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:20.116645 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:20.174171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a611f-3a1a-4508-91aa-b63f82b200f8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:20.177737 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:20.178372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:20.178653 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:20.179032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:20.188935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:20.190382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:20.200719 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1351/2648] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:20.468855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:20.470451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:20.488343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584457e-ce53-4ed3-8993-e15ee22a24c1 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:20.493299 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:20.494204 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:20.494487 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:20.494795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] PATH_INFO: `/v3/projects/aa9cc6f7ee9647d28cbb7b03c8fbdd1a` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:20.496007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9cc6f7ee9647d28cbb7b03c8fbdd1a)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:20.497937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:20.549876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9cc6f7ee9647d28cbb7b03c8fbdd1a', 'request_id': 'req-7b88a7d1-d825-4016-9baa-974931477f2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.556266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9cc6f7ee9647d28cbb7b03c8fbdd1a', 'request_id': 'req-7b88a7d1-d825-4016-9baa-974931477f2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.562587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9cc6f7ee9647d28cbb7b03c8fbdd1a', 'request_id': 'req-7b88a7d1-d825-4016-9baa-974931477f2c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.573965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] The token cache is being invalidate because project aa9cc6f7ee9647d28cbb7b03c8fbdd1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:20.574266 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.574913 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.576460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1298/2649] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:20 2022] DELETE /identity/v3/projects/aa9cc6f7ee9647d28cbb7b03c8fbdd1a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:20.580520 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:20.590970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8007e-b7f3-49e7-932b-79811a25fc33 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:20.644757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:20.645615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:20.645900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:20.646179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] PATH_INFO: `/v3/users/5e33aab56d9c4385b3e5ed31d2e02b75` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:20.647386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e33aab56d9c4385b3e5ed31d2e02b75)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:20.649380 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:20.686116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:20.696079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e33aab56d9c4385b3e5ed31d2e02b75'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.708957 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e33aab56d9c4385b3e5ed31d2e02b75'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.709628 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e33aab56d9c4385b3e5ed31d2e02b75'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.710237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e33aab56d9c4385b3e5ed31d2e02b75'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.717660 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-68242e95-2240-4a06-88ef-4e635afd4abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e33aab56d9c4385b3e5ed31d2e02b75'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:20.733043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1352/2650] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:20 2022] DELETE /identity/v3/users/5e33aab56d9c4385b3e5ed31d2e02b75 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:21.007685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.009161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:21.022473 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a7d1-d825-4016-9baa-974931477f2c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.081945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.082764 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.083048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.083321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] PATH_INFO: `/v3/projects/e25f03426b674b18a696980733c2ca96` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.084519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25f03426b674b18a696980733c2ca96)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.086886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.132825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25f03426b674b18a696980733c2ca96', 'request_id': 'req-06552b86-5f43-43d7-bccd-3dcd91a39929'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:21.135018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:21.141030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25f03426b674b18a696980733c2ca96', 'request_id': 'req-06552b86-5f43-43d7-bccd-3dcd91a39929'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:21.148124 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25f03426b674b18a696980733c2ca96', 'request_id': 'req-06552b86-5f43-43d7-bccd-3dcd91a39929'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:21.159308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] The token cache is being invalidate because project e25f03426b674b18a696980733c2ca96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:21.159594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:21.160269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-06552b86-5f43-43d7-bccd-3dcd91a39929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:21.161854 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1299/2651] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:21 2022] DELETE /identity/v3/projects/e25f03426b674b18a696980733c2ca96 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:21.167475 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b142-f6ba-46c2-a525-b21d9bb567f5 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.167960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b142-f6ba-46c2-a525-b21d9bb567f5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.168217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399b142-f6ba-46c2-a525-b21d9bb567f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.188586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d399b142-f6ba-46c2-a525-b21d9bb567f5 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:21.189806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d399b142-f6ba-46c2-a525-b21d9bb567f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:21.252351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1353/2652] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:21.262300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590982b-77c1-482f-8b59-56a89be2f2af None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.262592 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590982b-77c1-482f-8b59-56a89be2f2af None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.262904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590982b-77c1-482f-8b59-56a89be2f2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.282089 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5590982b-77c1-482f-8b59-56a89be2f2af None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:21.283439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5590982b-77c1-482f-8b59-56a89be2f2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:21.292936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1300/2653] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:21.297207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399b142-f6ba-46c2-a525-b21d9bb567f5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.307523 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399b142-f6ba-46c2-a525-b21d9bb567f5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.312789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.313572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.313979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.314526 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.315688 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:21.315913 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.317908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.331883 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1354/2654] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:21.336198 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590982b-77c1-482f-8b59-56a89be2f2af None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.345909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590982b-77c1-482f-8b59-56a89be2f2af None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.350645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.351326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.351608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.351884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.352581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.354500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.383911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1301/2655] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:21 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:21.389070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.399533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f428a53-2d36-46cd-9f03-5d2ebd142262 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.459139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.459815 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.460105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.460385 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.461088 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.463081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.485357 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1355/2656] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:21 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:21.488231 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.499575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b779b-76b5-4dd2-8bdc-a838af6538fe admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.504247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.504932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.505213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.505544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.506194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.507827 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.518667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1302/2657] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:29:21.522918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.533580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261aab-3394-4f9f-b79a-77672fe0055a admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.538671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002934d2-4577-4827-9a06-b91ce65821a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.539362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002934d2-4577-4827-9a06-b91ce65821a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.539686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002934d2-4577-4827-9a06-b91ce65821a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.539908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002934d2-4577-4827-9a06-b91ce65821a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.541396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002934d2-4577-4827-9a06-b91ce65821a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.542920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002934d2-4577-4827-9a06-b91ce65821a0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.553511 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1356/2658] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:21.558603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.569001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1a50-0d3b-49af-bdde-4dab09ef4588 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.573959 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.574877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.575161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.575439 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] PATH_INFO: `/v3/projects/34e3deb13bea49818e02f91529522609/users/684495817a194e8381aaf672eee09a6d/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.590903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e3deb13bea49818e02f91529522609, user_id=684495817a194e8381aaf672eee09a6d, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.593539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.608676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1303/2659] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:21 2022] PUT /identity/v3/projects/34e3deb13bea49818e02f91529522609/users/684495817a194e8381aaf672eee09a6d/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:21.619968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312508e-7eca-4260-bb24-fb64d08ef040 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.620324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312508e-7eca-4260-bb24-fb64d08ef040 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.620634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312508e-7eca-4260-bb24-fb64d08ef040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.652013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d312508e-7eca-4260-bb24-fb64d08ef040 None None] MFA Rules not processed for user `684495817a194e8381aaf672eee09a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:21.653749 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d312508e-7eca-4260-bb24-fb64d08ef040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:21.664714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:21.727535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1357/2660] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:21.732645 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.803177 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19442068-a82f-4002-a94c-1ef76936c346 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.807980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.808623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.808906 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.809182 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.809872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.811825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.836675 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1304/2661] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:21 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:21.841351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312508e-7eca-4260-bb24-fb64d08ef040 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.852538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312508e-7eca-4260-bb24-fb64d08ef040 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.909064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.909746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.910129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.910531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.911401 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.913664 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.936363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1358/2662] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:21 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:21.940510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.951372 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d6d43-0174-4bef-8910-114eaa14e574 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.956096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.956742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.957020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.957291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:21.958014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:21.959636 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:21.970137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1305/2663] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:21.974261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:21.984767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98af6f-db07-40d9-8c30-b66457fa7a52 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:21.989490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:21.990359 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:21.990668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:21.990970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] PATH_INFO: `/v3/projects/59b1967d3d634d708aef33d482aabcc7/users/4bc7c0493aea4d33a7d5c27e7f39b8d4/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.006007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b1967d3d634d708aef33d482aabcc7, user_id=4bc7c0493aea4d33a7d5c27e7f39b8d4, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:22.008684 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:22.022159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1359/2664] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:21 2022] PUT /identity/v3/projects/59b1967d3d634d708aef33d482aabcc7/users/4bc7c0493aea4d33a7d5c27e7f39b8d4/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:22.026073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.035798 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99abbe-bce0-4598-b67e-95d5b4579993 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.080957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:22.094905 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb83561-6963-4619-817a-8cb9d19c1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.095529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83561-6963-4619-817a-8cb9d19c1a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.095635 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83561-6963-4619-817a-8cb9d19c1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.095896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb83561-6963-4619-817a-8cb9d19c1a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.096620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83561-6963-4619-817a-8cb9d19c1a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:22.098225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb83561-6963-4619-817a-8cb9d19c1a22 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:22.108482 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1306/2665] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:22.112614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.123831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f244-ae9f-4d07-8544-2320e9b9b065 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.128641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.129516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.129807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.130086 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] PATH_INFO: `/v3/projects/59b1967d3d634d708aef33d482aabcc7/users/4bc7c0493aea4d33a7d5c27e7f39b8d4/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.132111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b1967d3d634d708aef33d482aabcc7, user_id=4bc7c0493aea4d33a7d5c27e7f39b8d4, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:22.134763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:22.145154 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1360/2666] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:22 2022] PUT /identity/v3/projects/59b1967d3d634d708aef33d482aabcc7/users/4bc7c0493aea4d33a7d5c27e7f39b8d4/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:22.156379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e93de7-4519-401a-8987-67cb3032b4e1 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.156667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e93de7-4519-401a-8987-67cb3032b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.156945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e93de7-4519-401a-8987-67cb3032b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.183748 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b2e93de7-4519-401a-8987-67cb3032b4e1 None None] MFA Rules not processed for user `4bc7c0493aea4d33a7d5c27e7f39b8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:22.184936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b2e93de7-4519-401a-8987-67cb3032b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:22.250669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1307/2667] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:22.261671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.263417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:22.320689 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98de376-2469-4d22-88e6-8011cd86751e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.325276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.325918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.326205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.326485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.335542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:22.336972 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:22.347236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1361/2668] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:22.444303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e93de7-4519-401a-8987-67cb3032b4e1 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:22.454889 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e93de7-4519-401a-8987-67cb3032b4e1 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:22.458480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc719bae-4b3c-4001-af26-8473c694a0fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:22.459151 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc719bae-4b3c-4001-af26-8473c694a0fd service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:22.459435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc719bae-4b3c-4001-af26-8473c694a0fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:22.459707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc719bae-4b3c-4001-af26-8473c694a0fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:22.518130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc719bae-4b3c-4001-af26-8473c694a0fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:22.519618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc719bae-4b3c-4001-af26-8473c694a0fd service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:22.528535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1308/2669] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:25.101896 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:25.107834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:25.164474 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0561ef-b7b4-4236-a850-992dd746c82e service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:25.169823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:25.170677 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.170987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.171260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] PATH_INFO: `/v3/users/684495817a194e8381aaf672eee09a6d` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.172453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=684495817a194e8381aaf672eee09a6d)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:25.174355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:25.233064 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684495817a194e8381aaf672eee09a6d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.246364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684495817a194e8381aaf672eee09a6d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.247152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684495817a194e8381aaf672eee09a6d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.247886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684495817a194e8381aaf672eee09a6d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.256023 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684495817a194e8381aaf672eee09a6d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.269158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1362/2670] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:25 2022] DELETE /identity/v3/users/684495817a194e8381aaf672eee09a6d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:25.273523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.274022 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.274132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.291643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:25.292755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:25.360543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1309/2671] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:25.370726 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:25.372856 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:25.445992 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa17734-020f-4b13-94f9-8cdc7f051c62 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:25.450075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:25.450787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.451090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.451364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.461089 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:25.463358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:25.475072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1363/2672] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:25.871249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:25.872728 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:25.885494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bef54-3b76-4a96-9a75-b7ab7f0220a8 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:25.890403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:25.891589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:25.891589 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:25.891857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] PATH_INFO: `/v3/projects/34e3deb13bea49818e02f91529522609` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:25.893085 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e3deb13bea49818e02f91529522609)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:25.895199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:25.897969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:25.954461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e3deb13bea49818e02f91529522609', 'request_id': 'req-231337d1-28bf-4715-8325-ce51fcf68d7c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.964130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e3deb13bea49818e02f91529522609', 'request_id': 'req-231337d1-28bf-4715-8325-ce51fcf68d7c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.974211 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e3deb13bea49818e02f91529522609', 'request_id': 'req-231337d1-28bf-4715-8325-ce51fcf68d7c'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.985045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] The token cache is being invalidate because project 34e3deb13bea49818e02f91529522609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:25.985336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.986016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:25.990500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1310/2673] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:25 2022] DELETE /identity/v3/projects/34e3deb13bea49818e02f91529522609 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:25.991993 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.001959 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa0d8c-cde4-4265-be94-bdd5c9280523 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.027375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:26.067508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.068300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.068598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.068877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] PATH_INFO: `/v3/users/4bc7c0493aea4d33a7d5c27e7f39b8d4` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.070094 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc7c0493aea4d33a7d5c27e7f39b8d4)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.073268 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.120283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc7c0493aea4d33a7d5c27e7f39b8d4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.131715 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc7c0493aea4d33a7d5c27e7f39b8d4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.132382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc7c0493aea4d33a7d5c27e7f39b8d4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.132981 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc7c0493aea4d33a7d5c27e7f39b8d4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.140703 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-e4e7f147-1580-4313-8e96-4d3edf94b533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc7c0493aea4d33a7d5c27e7f39b8d4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.154317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1364/2674] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:25 2022] DELETE /identity/v3/users/4bc7c0493aea4d33a7d5c27e7f39b8d4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:26.430375 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.432456 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:26.445829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231337d1-28bf-4715-8325-ce51fcf68d7c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.506936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.507794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.508076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.508345 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] PATH_INFO: `/v3/projects/59b1967d3d634d708aef33d482aabcc7` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.509519 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b1967d3d634d708aef33d482aabcc7)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.512056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.558512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b1967d3d634d708aef33d482aabcc7', 'request_id': 'req-e2a93b89-0203-430c-91f0-892d0c7e7d62'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.565932 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b1967d3d634d708aef33d482aabcc7', 'request_id': 'req-e2a93b89-0203-430c-91f0-892d0c7e7d62'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.572699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b1967d3d634d708aef33d482aabcc7', 'request_id': 'req-e2a93b89-0203-430c-91f0-892d0c7e7d62'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.583195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] The token cache is being invalidate because project 59b1967d3d634d708aef33d482aabcc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:26.583480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.584113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-e2a93b89-0203-430c-91f0-892d0c7e7d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:26.585843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1311/2675] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:26 2022] DELETE /identity/v3/projects/59b1967d3d634d708aef33d482aabcc7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:26.591418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e3cbd-e054-4322-8b93-112a81df3a93 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.591708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e3cbd-e054-4322-8b93-112a81df3a93 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.591985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e3cbd-e054-4322-8b93-112a81df3a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.609307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-787e3cbd-e054-4322-8b93-112a81df3a93 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:26.610510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-787e3cbd-e054-4322-8b93-112a81df3a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:26.669079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1365/2676] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:26.676225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414f8c-d4e5-47e8-b1b1-d66e011ab01c None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.676521 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414f8c-d4e5-47e8-b1b1-d66e011ab01c None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.676812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414f8c-d4e5-47e8-b1b1-d66e011ab01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.694947 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-bb414f8c-d4e5-47e8-b1b1-d66e011ab01c None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:26.696327 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-bb414f8c-d4e5-47e8-b1b1-d66e011ab01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:26.705115 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1312/2677] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:26.709359 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e3cbd-e054-4322-8b93-112a81df3a93 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.720699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e3cbd-e054-4322-8b93-112a81df3a93 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.725449 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.726133 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.726408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.726706 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.727448 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:26.727755 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.729352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.740858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1366/2678] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:26.745304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb414f8c-d4e5-47e8-b1b1-d66e011ab01c None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.754864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb414f8c-d4e5-47e8-b1b1-d66e011ab01c None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.759544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.760703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.760980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.761249 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.761926 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.763894 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.777410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:26.792702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1313/2679] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:26 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:26.796742 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.806651 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873b1ff-0423-4d8b-914b-2bdf987aab1e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.837239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:26.865201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.865863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.866147 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.866428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.867148 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.869077 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.888505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1367/2680] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:26 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:26.892579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.905505 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb631-7d4b-4979-8a6f-885a83b846c6 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.910220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.910919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.911212 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.911493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.912223 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.913840 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.924514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1314/2681] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:29:26.928462 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.938811 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307703-c1d1-4034-949c-22bec6edc1c7 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.944549 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994d943-e314-4525-89b1-5fdbc4f748f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.945356 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994d943-e314-4525-89b1-5fdbc4f748f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.945641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994d943-e314-4525-89b1-5fdbc4f748f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.946065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994d943-e314-4525-89b1-5fdbc4f748f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.946836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994d943-e314-4525-89b1-5fdbc4f748f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:26.949709 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994d943-e314-4525-89b1-5fdbc4f748f2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:26.960777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1368/2682] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:26.965067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:26.975095 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db3fad-d31a-4472-ab8e-a31a7523e54e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:26.979846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:26.980718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:26.980998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:26.981270 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] PATH_INFO: `/v3/projects/805b4c28db9f4520b50eba0d15075ee5/users/b4dd4e333915445daa3ddc23c5c1b1be/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:26.997291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=805b4c28db9f4520b50eba0d15075ee5, user_id=b4dd4e333915445daa3ddc23c5c1b1be, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.000014 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.013664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1315/2683] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:26 2022] PUT /identity/v3/projects/805b4c28db9f4520b50eba0d15075ee5/users/b4dd4e333915445daa3ddc23c5c1b1be/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:27.023878 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7cfef-20e4-4cf5-bdf5-29b633afa5a5 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.024159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7cfef-20e4-4cf5-bdf5-29b633afa5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.024437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7cfef-20e4-4cf5-bdf5-29b633afa5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.049809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-28b7cfef-20e4-4cf5-bdf5-29b633afa5a5 None None] MFA Rules not processed for user `b4dd4e333915445daa3ddc23c5c1b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:27.051043 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-28b7cfef-20e4-4cf5-bdf5-29b633afa5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:27.115217 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1369/2684] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:27.120180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.188001 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ff57c-e402-4219-ad9b-97832bb337ac admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.192918 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.193580 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.193865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.200919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.200919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.200919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.225103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1316/2685] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:27 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:29:27.228924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7cfef-20e4-4cf5-bdf5-29b633afa5a5 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.239545 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7cfef-20e4-4cf5-bdf5-29b633afa5a5 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.304797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.305589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.305814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.306072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.307722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.312074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.334738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1370/2686] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:27 2022] POST /identity/v3/users => generated 310 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:27.339278 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.350516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ad636-bbd0-4297-8a65-81026ce2d106 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.355655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.356329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.356611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.356907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.357620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.359253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.370332 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1317/2687] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:27.374553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.384419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f5286-ce17-44df-b182-bba0943d2706 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.389045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.389912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.390196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.390471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] PATH_INFO: `/v3/projects/b98f0ccb860347258e2c060c03ab3380/users/0903cdff7f664a3abb23ba0f62c765e7/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.405365 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98f0ccb860347258e2c060c03ab3380, user_id=0903cdff7f664a3abb23ba0f62c765e7, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.408118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.421774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1371/2688] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:27 2022] PUT /identity/v3/projects/b98f0ccb860347258e2c060c03ab3380/users/0903cdff7f664a3abb23ba0f62c765e7/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:29:27.425937 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.437019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a417a8-92ea-49f5-8e42-65e7cac56b6f admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.497226 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dfc51-7554-46b3-b457-415b8fcb1529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.497925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfc51-7554-46b3-b457-415b8fcb1529 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.498205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfc51-7554-46b3-b457-415b8fcb1529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.498476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfc51-7554-46b3-b457-415b8fcb1529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.499258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dfc51-7554-46b3-b457-415b8fcb1529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.500896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dfc51-7554-46b3-b457-415b8fcb1529 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.511444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1318/2689] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:27.516489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.527000 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeecfa8-f6ec-4a64-b5fa-a3d519450188 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.531672 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.532548 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.532832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.533108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] PATH_INFO: `/v3/projects/b98f0ccb860347258e2c060c03ab3380/users/0903cdff7f664a3abb23ba0f62c765e7/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.535111 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98f0ccb860347258e2c060c03ab3380, user_id=0903cdff7f664a3abb23ba0f62c765e7, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.537777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.540044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:27.550635 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1372/2690] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:27 2022] PUT /identity/v3/projects/b98f0ccb860347258e2c060c03ab3380/users/0903cdff7f664a3abb23ba0f62c765e7/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:29:27.562874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a768b1b-41e8-4a49-ae65-abc1b3eb774a None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.563163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a768b1b-41e8-4a49-ae65-abc1b3eb774a None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.563464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a768b1b-41e8-4a49-ae65-abc1b3eb774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.589188 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-7a768b1b-41e8-4a49-ae65-abc1b3eb774a None None] MFA Rules not processed for user `0903cdff7f664a3abb23ba0f62c765e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:27.590381 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-7a768b1b-41e8-4a49-ae65-abc1b3eb774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:27.608070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:27.663855 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1319/2691] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:27 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:27.674894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.676588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:27.734756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68d20-05fe-4119-9693-2059aace9d46 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.738622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.739303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.739593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.739861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.748986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.750396 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.759702 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1373/2692] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:27 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:27.905121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a768b1b-41e8-4a49-ae65-abc1b3eb774a None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:27.915709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a768b1b-41e8-4a49-ae65-abc1b3eb774a None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:27.920418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:27.921059 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:27.921341 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:27.921623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:27.977946 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:27.979432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:27.988269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1320/2693] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:28.422772 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:28.424158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:28.480630 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4fafe-0c37-4b99-a160-77152afde266 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:28.484174 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:28.484822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:28.485105 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:28.485377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:28.487192 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:28.554831 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:28.556277 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:28.566073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1374/2694] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:31.707123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:31.708656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:31.727697 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bafae-c31c-4ce7-b352-210b55955641 service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:31.734543 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:31.735723 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:31.736008 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:31.736282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] PATH_INFO: `/v3/users/4c65e6495f7e43408c26706c89f61ad0` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:31.737535 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c65e6495f7e43408c26706c89f61ad0)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:31.739807 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:31.797702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c65e6495f7e43408c26706c89f61ad0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:31.816329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c65e6495f7e43408c26706c89f61ad0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:31.818464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c65e6495f7e43408c26706c89f61ad0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:31.819424 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c65e6495f7e43408c26706c89f61ad0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:31.831470 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-44b7c5cc-812b-49a4-939d-ce31118245e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c65e6495f7e43408c26706c89f61ad0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:31.854309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1321/2695] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:31 2022] DELETE /identity/v3/users/4c65e6495f7e43408c26706c89f61ad0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:32.033836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.049282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634757b5-6a8a-43ed-9517-c4e5de626432 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.099744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:32.116763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.117615 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.117897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.118171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] PATH_INFO: `/v3/projects/97676089d6c14acc83bca866d0fae6e2` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.119355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97676089d6c14acc83bca866d0fae6e2)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.121260 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.166551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97676089d6c14acc83bca866d0fae6e2', 'request_id': 'req-d1fb9b57-5b60-4091-a6be-024476e23c8b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:32.173705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97676089d6c14acc83bca866d0fae6e2', 'request_id': 'req-d1fb9b57-5b60-4091-a6be-024476e23c8b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:32.180030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97676089d6c14acc83bca866d0fae6e2', 'request_id': 'req-d1fb9b57-5b60-4091-a6be-024476e23c8b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:32.190894 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] The token cache is being invalidate because project 97676089d6c14acc83bca866d0fae6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:32.191182 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:32.191807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-d1fb9b57-5b60-4091-a6be-024476e23c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:32.193346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1375/2696] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:32 2022] DELETE /identity/v3/projects/97676089d6c14acc83bca866d0fae6e2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:29:32.199136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cf2c-054e-4013-9c10-6eb0dd1fa34d None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.199425 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cf2c-054e-4013-9c10-6eb0dd1fa34d None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.199703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cf2c-054e-4013-9c10-6eb0dd1fa34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.216858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f0c2cf2c-054e-4013-9c10-6eb0dd1fa34d None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:32.217972 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f0c2cf2c-054e-4013-9c10-6eb0dd1fa34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:32.236699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:32.279953 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1322/2697] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:32.288623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17f0e-f01b-4bff-a775-b0e9162ec9e4 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.288950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17f0e-f01b-4bff-a775-b0e9162ec9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.289235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17f0e-f01b-4bff-a775-b0e9162ec9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.307949 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9fd17f0e-f01b-4bff-a775-b0e9162ec9e4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:32.309158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9fd17f0e-f01b-4bff-a775-b0e9162ec9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:32.317670 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1376/2698] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:32.321929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cf2c-054e-4013-9c10-6eb0dd1fa34d None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.332576 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cf2c-054e-4013-9c10-6eb0dd1fa34d None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.337103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.337750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.338037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.338320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.339075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:32.339397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.341007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.357090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1323/2699] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:29:32.361988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17f0e-f01b-4bff-a775-b0e9162ec9e4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.372595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17f0e-f01b-4bff-a775-b0e9162ec9e4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.377308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.377964 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.378281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.378563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.379300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.381187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.408264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1377/2700] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:32 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:32.412403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.422193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67fcd-9fec-402c-a784-ddf5a0ef3c86 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.477978 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.478578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.478893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.479175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.479910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.481879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.503441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1324/2701] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:32 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:32.507713 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.518708 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee70f4-0096-4661-afbe-6b039829ee43 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.523339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.523988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.524271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.524547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.525270 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.526920 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.537162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1378/2702] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:32.541654 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.551526 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95484881-9323-4ef4-a723-1ffd536ceef8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.556145 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ec00d-dfb6-46fe-a91d-793efcc14cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.557514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ec00d-dfb6-46fe-a91d-793efcc14cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.557800 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ec00d-dfb6-46fe-a91d-793efcc14cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.558080 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ec00d-dfb6-46fe-a91d-793efcc14cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.558838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ec00d-dfb6-46fe-a91d-793efcc14cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.560452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ec00d-dfb6-46fe-a91d-793efcc14cbd admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.570269 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1325/2703] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:32.575330 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.586082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c782d-dddf-4a52-b4ad-2d808092801e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.591563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.592495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.592757 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.593189 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] PATH_INFO: `/v3/projects/6b5693ab060c4dc98949c1e9cf1a331a/users/25bf2b36b0ea472897721c924371ca95/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.612935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5693ab060c4dc98949c1e9cf1a331a, user_id=25bf2b36b0ea472897721c924371ca95, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.615634 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.637049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1379/2704] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:32 2022] PUT /identity/v3/projects/6b5693ab060c4dc98949c1e9cf1a331a/users/25bf2b36b0ea472897721c924371ca95/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:32.642259 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.642563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.642869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.660601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:32.661785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:32.723033 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1326/2705] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:32.733730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:32.735460 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:32.796503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc4436-8964-4b13-8456-d8eb19e98688 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:32.800399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dbd03-6970-48b9-af72-4b2dd9b566dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:32.801044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dbd03-6970-48b9-af72-4b2dd9b566dc service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:32.801331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dbd03-6970-48b9-af72-4b2dd9b566dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:32.801613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dbd03-6970-48b9-af72-4b2dd9b566dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:32.811813 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dbd03-6970-48b9-af72-4b2dd9b566dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:32.813371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dbd03-6970-48b9-af72-4b2dd9b566dc service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:32.824661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1380/2706] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:36.849185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:36.851311 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:36.879573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90defa1d-0f41-4c0a-bc68-b2ee83553fae None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:36.903563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:36.904407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:36.904693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:36.904967 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] PATH_INFO: `/v3/users/b4dd4e333915445daa3ddc23c5c1b1be` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:36.908180 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dd4e333915445daa3ddc23c5c1b1be)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:36.910164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:37.028347 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:37.028866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:37.028866 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:37.037161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:37.064471 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dd4e333915445daa3ddc23c5c1b1be'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:37.098209 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] MFA Rules not processed for user `b5c6ce36b61745a38e07b2f39b1d5a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:37.105068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:37.109492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dd4e333915445daa3ddc23c5c1b1be'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:37.110776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dd4e333915445daa3ddc23c5c1b1be'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:37.113057 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dd4e333915445daa3ddc23c5c1b1be'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:37.125771 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-4580215a-2440-45af-ac82-f941861ba9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dd4e333915445daa3ddc23c5c1b1be'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:37.141049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:37.163195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1327/2707] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:36 2022] DELETE /identity/v3/users/b4dd4e333915445daa3ddc23c5c1b1be => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:37.177584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:37.178293 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:37.180208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:37.233035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:37.236549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:37.344339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1381/2708] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:37.420323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1328/2709] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:37.440954 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:37.449044 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:37.481542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02b21c-6552-4877-83a7-34dad3d60a2d None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:37.604655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:37.605324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:37.605605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:37.605879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:37.628047 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:37.629522 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:37.653027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1382/2710] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:38.708155 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:38.709606 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:38.723091 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28105b-90c5-4ef6-9d4a-ce8926f2143b None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:38.729277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:38.730147 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:38.730431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:38.730755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] PATH_INFO: `/v3/projects/805b4c28db9f4520b50eba0d15075ee5` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:38.732516 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805b4c28db9f4520b50eba0d15075ee5)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:38.734612 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:38.799616 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805b4c28db9f4520b50eba0d15075ee5', 'request_id': 'req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:38.811205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805b4c28db9f4520b50eba0d15075ee5', 'request_id': 'req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:38.822986 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805b4c28db9f4520b50eba0d15075ee5', 'request_id': 'req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:38.836159 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] The token cache is being invalidate because project 805b4c28db9f4520b50eba0d15075ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:38.836461 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:38.837192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:38.841987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1329/2711] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:38 2022] DELETE /identity/v3/projects/805b4c28db9f4520b50eba0d15075ee5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:38.843734 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:38.858960 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a98e4-e0c1-4936-a27d-842b476ce84a service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:38.981775 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:38.983075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:38.983425 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:38.983814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] PATH_INFO: `/v3/users/0903cdff7f664a3abb23ba0f62c765e7` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:38.985314 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0903cdff7f664a3abb23ba0f62c765e7)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:38.987423 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:39.108265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0903cdff7f664a3abb23ba0f62c765e7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:39.142199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0903cdff7f664a3abb23ba0f62c765e7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:39.143578 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0903cdff7f664a3abb23ba0f62c765e7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:39.150902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0903cdff7f664a3abb23ba0f62c765e7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:39.153082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:39.161769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-de6eedc5-6ba1-4725-95a8-06a542616111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0903cdff7f664a3abb23ba0f62c765e7'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:39.201593 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1383/2712] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:38 2022] DELETE /identity/v3/users/0903cdff7f664a3abb23ba0f62c765e7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:40.091838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.094539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:40.113677 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8aed-1eda-4b94-87b5-6cc992bb7b76 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.155874 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:40.204748 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.205282 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.206655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.207615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.207893 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.208358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] PATH_INFO: `/v3/projects/b98f0ccb860347258e2c060c03ab3380` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.208705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.209682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98f0ccb860347258e2c060c03ab3380)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.211841 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.252718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] MFA Rules not processed for user `25bf2b36b0ea472897721c924371ca95`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:40.253975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:40.272641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98f0ccb860347258e2c060c03ab3380', 'request_id': 'req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:40.286528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98f0ccb860347258e2c060c03ab3380', 'request_id': 'req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:40.294650 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98f0ccb860347258e2c060c03ab3380', 'request_id': 'req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:40.305780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] The token cache is being invalidate because project b98f0ccb860347258e2c060c03ab3380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:40.306067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:40.306786 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-f4b02a85-618a-45a2-a8a2-46fdb07c3fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:40.308423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1330/2713] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:40 2022] DELETE /identity/v3/projects/b98f0ccb860347258e2c060c03ab3380 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:40.313233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973561b1-c727-402f-b1a3-82503779ad64 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.313673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973561b1-c727-402f-b1a3-82503779ad64 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.314056 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973561b1-c727-402f-b1a3-82503779ad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.344263 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-973561b1-c727-402f-b1a3-82503779ad64 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:40.344604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1384/2714] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:40.346835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-973561b1-c727-402f-b1a3-82503779ad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:40.358823 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.360237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:40.413802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1331/2715] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:29:40.421669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15939-f240-4ad6-9992-7f141bbbb772 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.421963 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15939-f240-4ad6-9992-7f141bbbb772 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.422247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15939-f240-4ad6-9992-7f141bbbb772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.443109 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-aae15939-f240-4ad6-9992-7f141bbbb772 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:40.444368 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-aae15939-f240-4ad6-9992-7f141bbbb772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:40.444730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16f26a-35cd-463e-b168-9c7d0b374941 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.451700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.452360 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.452648 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.452927 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.453941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1332/2716] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:29:40.458018 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae15939-f240-4ad6-9992-7f141bbbb772 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.461646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.463735 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.467031 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae15939-f240-4ad6-9992-7f141bbbb772 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.473232 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.477477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.477477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.477477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.477477 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:29:40.477918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1385/2717] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:29:40.483092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.487315 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.502604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1333/2718] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:29:40.506798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.519206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e196368-998d-408f-81f0-d6f81d938ffd service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.524844 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.525536 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.525820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.526784 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.527590 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.529595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.558722 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1386/2719] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:29:40 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:29:40.562528 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.578084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ffd8c-cb5a-417b-8c70-b0cb127bf33b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.623219 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:40.651342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.652172 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.652554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.652843 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.653542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.655507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.676624 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1334/2720] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:29:40 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:29:40.680485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.692013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12598f8-824e-4223-90ca-4089c2fd8363 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.698292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.699092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.699539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.699822 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.700627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.702782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.727060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1387/2721] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:29:40.731548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.741741 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd23b6-de05-41db-8ce6-52643005b081 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.747035 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180c741-9b25-4ff6-8bbe-741cf1c48ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.747716 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c741-9b25-4ff6-8bbe-741cf1c48ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.747984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c741-9b25-4ff6-8bbe-741cf1c48ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.748301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c741-9b25-4ff6-8bbe-741cf1c48ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.749032 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c741-9b25-4ff6-8bbe-741cf1c48ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.750715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c741-9b25-4ff6-8bbe-741cf1c48ed6 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.763418 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1335/2722] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:29:40.767743 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:40.779997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c817-67e5-443e-b870-fbdacac901ef admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:40.785445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:40.786851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.787272 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.787789 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] PATH_INFO: `/v3/projects/aa61017390ea440d8a468917acede86e/users/6a736c8d0513452c878adeb0cf3a440d/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.805376 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa61017390ea440d8a468917acede86e, user_id=6a736c8d0513452c878adeb0cf3a440d, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:40.809714 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:40.821723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:40.828505 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1388/2723] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:29:40 2022] PUT /identity/v3/projects/aa61017390ea440d8a468917acede86e/users/6a736c8d0513452c878adeb0cf3a440d/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:29:40.839568 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad905d4-b883-4b60-9cdd-dbc6ca803aad None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:40.839766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad905d4-b883-4b60-9cdd-dbc6ca803aad None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:40.840047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad905d4-b883-4b60-9cdd-dbc6ca803aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:40.897970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-fad905d4-b883-4b60-9cdd-dbc6ca803aad None None] MFA Rules not processed for user `6a736c8d0513452c878adeb0cf3a440d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:40.899242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-fad905d4-b883-4b60-9cdd-dbc6ca803aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:40.996481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1336/2724] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:41.009850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:41.012142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:41.106967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e23bdc-dc61-4f2d-9aba-5da9713ccc6c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:41.111018 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33a70f-2c5d-4fc3-8256-55941ebe3a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:41.111796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a70f-2c5d-4fc3-8256-55941ebe3a00 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:41.112083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a70f-2c5d-4fc3-8256-55941ebe3a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:41.112834 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33a70f-2c5d-4fc3-8256-55941ebe3a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:41.124216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33a70f-2c5d-4fc3-8256-55941ebe3a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:41.126099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33a70f-2c5d-4fc3-8256-55941ebe3a00 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:41.142013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1389/2725] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:29:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:29:42.209984 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:42.210524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:42.210524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:42.233373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] MFA Rules not processed for user `25bf2b36b0ea472897721c924371ca95`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:42.234611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:42.342753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1337/2726] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:43.731262 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:43.731797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:43.731908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:43.761004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] MFA Rules not processed for user `98c15d7378aa4684978de5fc5dd757fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:29:43.765893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:43.847668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1390/2727] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 30 10:29:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:29:43.879429 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:43.881309 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:43.961450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:43.992501 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087a3e8-be9b-4229-b314-3d0c70491869 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:43.998773 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56e635c1ca5341b2892f0c8846b280d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:43.999599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:43.999885 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:44.000164 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:44.009732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:44.011480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:44.026422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1338/2728] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 30 10:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 10:29:53.362141 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:53.363934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:53.435874 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738c3f2-63ba-4f26-80ed-235f7135ded8 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:53.440456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:53.441430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:53.441656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:53.442072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] PATH_INFO: `/v3/users/9d931bcea07342a5a74a5d9de64d1465` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:53.443596 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d931bcea07342a5a74a5d9de64d1465)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:53.445829 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:53.505387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d931bcea07342a5a74a5d9de64d1465'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.507739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:53.523796 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d931bcea07342a5a74a5d9de64d1465'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.525072 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d931bcea07342a5a74a5d9de64d1465'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.525863 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d931bcea07342a5a74a5d9de64d1465'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.532997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d931bcea07342a5a74a5d9de64d1465'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.545712 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1391/2729] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:53 2022] DELETE /identity/v3/users/9d931bcea07342a5a74a5d9de64d1465 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:53.727148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:53.743123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c56cad-89eb-4ca9-bf69-a27954da43cb service swift] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:53.800302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:53.801152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:53.801441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:53.801709 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] PATH_INFO: `/v3/projects/6bf471198043490896b5f99c7e004168` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:53.802923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf471198043490896b5f99c7e004168)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:53.804881 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:53.851994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf471198043490896b5f99c7e004168', 'request_id': 'req-5c52c6ff-3a4b-486e-ab82-37e849eacd08'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.859847 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf471198043490896b5f99c7e004168', 'request_id': 'req-5c52c6ff-3a4b-486e-ab82-37e849eacd08'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.866367 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf471198043490896b5f99c7e004168', 'request_id': 'req-5c52c6ff-3a4b-486e-ab82-37e849eacd08'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.876599 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] The token cache is being invalidate because project 6bf471198043490896b5f99c7e004168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:53.876882 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.877504 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:53.879071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1339/2730] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:53 2022] DELETE /identity/v3/projects/6bf471198043490896b5f99c7e004168 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:53.883095 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:53.885045 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:53.898680 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3a52-917c-43af-93c7-803bdab89653 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:53.955782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:53.956654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:53.956943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:53.957267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] PATH_INFO: `/v3/users/a510223a6c174d59a4eae7ca670f19af` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:53.958437 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a510223a6c174d59a4eae7ca670f19af)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:53.960422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:54.006168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a510223a6c174d59a4eae7ca670f19af'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.018788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a510223a6c174d59a4eae7ca670f19af'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.019453 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a510223a6c174d59a4eae7ca670f19af'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.020055 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a510223a6c174d59a4eae7ca670f19af'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.026816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a510223a6c174d59a4eae7ca670f19af'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.039783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1392/2731] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:29:53 2022] DELETE /identity/v3/users/a510223a6c174d59a4eae7ca670f19af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:29:54.214945 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:29:54.216552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:29:54.231759 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c6ff-3a4b-486e-ab82-37e849eacd08 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:29:54.297542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:29:54.298428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:29:54.298718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:29:54.298992 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] PATH_INFO: `/v3/projects/54ec9ab577e84767a148aad395e009ef` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:29:54.300462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ec9ab577e84767a148aad395e009ef)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:29:54.302756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:29:54.315090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:29:54.361428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ec9ab577e84767a148aad395e009ef', 'request_id': 'req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.369431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ec9ab577e84767a148aad395e009ef', 'request_id': 'req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.376927 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ec9ab577e84767a148aad395e009ef', 'request_id': 'req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.388060 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] The token cache is being invalidate because project 54ec9ab577e84767a148aad395e009ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:29:54.388303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.388974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-9f202ee4-64c4-4f0a-9b5a-8a583f74cfa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:29:54.390534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1340/2732] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:29:54 2022] DELETE /identity/v3/projects/54ec9ab577e84767a148aad395e009ef => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:00.575341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:00.576782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:00.590281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5610f6c-0373-4d6e-935f-18c1eed32fb3 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:00.643436 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:00.659082 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:00.659962 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:00.660242 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:00.660516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] PATH_INFO: `/v3/users/6a736c8d0513452c878adeb0cf3a440d` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:00.661727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a736c8d0513452c878adeb0cf3a440d)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:00.663711 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:00.710220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a736c8d0513452c878adeb0cf3a440d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:00.721698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a736c8d0513452c878adeb0cf3a440d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:00.722354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a736c8d0513452c878adeb0cf3a440d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:00.722984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a736c8d0513452c878adeb0cf3a440d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:00.731227 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a736c8d0513452c878adeb0cf3a440d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:00.744480 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1393/2733] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:30:00 2022] DELETE /identity/v3/users/6a736c8d0513452c878adeb0cf3a440d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:00.748876 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:00.749351 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:00.749452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:00.767275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:00.768466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:00.828824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1341/2734] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:30:00.838774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:00.840251 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:00.897552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9a50a-412d-4b55-894e-baac633283c4 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:00.901291 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a493c-6b3d-47df-93d3-f174713e7ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:00.901930 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a493c-6b3d-47df-93d3-f174713e7ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:00.902214 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a493c-6b3d-47df-93d3-f174713e7ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:00.902489 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a493c-6b3d-47df-93d3-f174713e7ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:00.911510 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a493c-6b3d-47df-93d3-f174713e7ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:00.913067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a493c-6b3d-47df-93d3-f174713e7ad3 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:00.923186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1394/2735] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:30:01.224017 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:01.225715 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:01.238617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d1954-3f4c-4cc6-a09e-a439a33d91db None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:01.244846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:01.245233 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.245637 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.245997 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] PATH_INFO: `/v3/projects/aa61017390ea440d8a468917acede86e` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.247524 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa61017390ea440d8a468917acede86e)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:01.249546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:01.304640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa61017390ea440d8a468917acede86e', 'request_id': 'req-ee93798b-3b6d-4f49-b782-03016ac0beed'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:01.312497 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa61017390ea440d8a468917acede86e', 'request_id': 'req-ee93798b-3b6d-4f49-b782-03016ac0beed'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:01.320886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa61017390ea440d8a468917acede86e', 'request_id': 'req-ee93798b-3b6d-4f49-b782-03016ac0beed'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:01.332067 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] The token cache is being invalidate because project aa61017390ea440d8a468917acede86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:30:01.332339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:01.332998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ee93798b-3b6d-4f49-b782-03016ac0beed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:01.334556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1342/2736] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:30:01 2022] DELETE /identity/v3/projects/aa61017390ea440d8a468917acede86e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:30:01.339362 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691b8c-0020-46d0-afc1-79849e810be2 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.339681 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691b8c-0020-46d0-afc1-79849e810be2 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.339963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e691b8c-0020-46d0-afc1-79849e810be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.358497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-2e691b8c-0020-46d0-afc1-79849e810be2 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:01.359828 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-2e691b8c-0020-46d0-afc1-79849e810be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:01.430857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1395/2737] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:30:01.438431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663435bf-c991-4758-9398-5e8887a3cfd1 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.438742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663435bf-c991-4758-9398-5e8887a3cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.439027 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663435bf-c991-4758-9398-5e8887a3cfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.458641 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-663435bf-c991-4758-9398-5e8887a3cfd1 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:01.459987 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-663435bf-c991-4758-9398-5e8887a3cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:01.467980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1343/2738] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:30:01.472198 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691b8c-0020-46d0-afc1-79849e810be2 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:01.487075 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e691b8c-0020-46d0-afc1-79849e810be2 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:01.492338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:01.493508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.493790 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.494063 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.494885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:30:01.495174 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:01.496761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:01.499864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:01.511996 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1396/2739] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:30:01.516041 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663435bf-c991-4758-9398-5e8887a3cfd1 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:01.525792 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663435bf-c991-4758-9398-5e8887a3cfd1 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:01.530549 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:01.531245 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.531534 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.531811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.532602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:01.534431 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:01.549325 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:01.568072 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1344/2740] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:30:01 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:01.569180 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:01.579446 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0d0c-4223-4268-9ad1-16c1c3a7e3c0 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:01.648723 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:01.650300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.650939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.651441 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.652311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:01.654594 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:01.678237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1397/2741] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:30:01 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:01.679480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:01.690533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2b4ba-acae-4938-a782-ad5687312659 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:01.695104 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:01.695802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.696084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.696362 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.697090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:01.699037 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:01.710153 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1345/2742] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:30:01.714840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:01.724840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1e801-b983-46cc-9adb-759ab88c1b0c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:01.730152 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2168710-71b4-4ec4-9000-54ca9cdca3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:01.730850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168710-71b4-4ec4-9000-54ca9cdca3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.731138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168710-71b4-4ec4-9000-54ca9cdca3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.731415 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2168710-71b4-4ec4-9000-54ca9cdca3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.732140 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2168710-71b4-4ec4-9000-54ca9cdca3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:01.733744 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2168710-71b4-4ec4-9000-54ca9cdca3e7 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:01.743827 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1398/2743] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:30:01.747911 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:01.757837 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682f063-4736-4468-98bb-80b045daf985 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:01.763119 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:01.764002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.764282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.764554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] PATH_INFO: `/v3/projects/bfbab252527441d581746b77e64f251c/users/3a7e90f905684b20b8a7bf87426d8bca/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.784391 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbab252527441d581746b77e64f251c, user_id=3a7e90f905684b20b8a7bf87426d8bca, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:01.787688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:01.806539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1346/2744] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:30:01 2022] PUT /identity/v3/projects/bfbab252527441d581746b77e64f251c/users/3a7e90f905684b20b8a7bf87426d8bca/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:01.816584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96665b7-ee6a-46f1-b65e-389c4cfd1429 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:01.816886 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96665b7-ee6a-46f1-b65e-389c4cfd1429 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:01.817166 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96665b7-ee6a-46f1-b65e-389c4cfd1429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:01.845858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e96665b7-ee6a-46f1-b65e-389c4cfd1429 None None] MFA Rules not processed for user `3a7e90f905684b20b8a7bf87426d8bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:01.847029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e96665b7-ee6a-46f1-b65e-389c4cfd1429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:01.911836 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1399/2745] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:30:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:30:01.916446 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.002897 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e412-64fd-4b24-b104-859e19ec97e8 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.009187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.009871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.010152 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.010428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.012867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.013618 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.044722 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1347/2746] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:30:01 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:02.048893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96665b7-ee6a-46f1-b65e-389c4cfd1429 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.063973 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96665b7-ee6a-46f1-b65e-389c4cfd1429 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.139332 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.139922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.140254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.140472 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.141184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.143150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.152865 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:02.166080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1400/2747] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:30:02 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:02.169998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.181604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d195-c0d1-47c5-8096-19c74d7f238c admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.186314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.187038 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.187347 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.187617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.188373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.189974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.203046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1348/2748] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:30:02.207455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.218379 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323a5ed-cff8-4852-9432-ae7201b63b7f admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.223121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f08f9-6625-44b6-a89e-d8869566716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.223783 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f08f9-6625-44b6-a89e-d8869566716b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.224065 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f08f9-6625-44b6-a89e-d8869566716b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.224338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f08f9-6625-44b6-a89e-d8869566716b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.225067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f08f9-6625-44b6-a89e-d8869566716b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.227071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f08f9-6625-44b6-a89e-d8869566716b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.240273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1401/2749] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:30:02.241852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.253220 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021e517-76df-4d88-892b-e1040b3b622d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.258141 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.259812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.260092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.260361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] PATH_INFO: `/v3/projects/b4fbba6cdcfc4f0b8240eb9282bcb866/users/4b2a6a0d66af42798ab99b26b8e26e83/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.276338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fbba6cdcfc4f0b8240eb9282bcb866, user_id=4b2a6a0d66af42798ab99b26b8e26e83, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.279055 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.296842 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1349/2750] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:30:02 2022] PUT /identity/v3/projects/b4fbba6cdcfc4f0b8240eb9282bcb866/users/4b2a6a0d66af42798ab99b26b8e26e83/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:02.308718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08076704-5613-4613-bb98-025fe66bc156 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.308975 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08076704-5613-4613-bb98-025fe66bc156 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.309996 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08076704-5613-4613-bb98-025fe66bc156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.341773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-08076704-5613-4613-bb98-025fe66bc156 None None] MFA Rules not processed for user `4b2a6a0d66af42798ab99b26b8e26e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:02.343079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-08076704-5613-4613-bb98-025fe66bc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:02.432125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1402/2751] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:30:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:30:02.437096 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.541574 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c756e2-80da-431a-b394-4a9a51b12401 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.549640 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.551484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.551484 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.551714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.552999 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.557970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.578176 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:02.626564 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1350/2752] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:30:02 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:02.630503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08076704-5613-4613-bb98-025fe66bc156 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.646081 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08076704-5613-4613-bb98-025fe66bc156 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.712624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.713297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.713585 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.713864 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.714556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.716501 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.737907 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1403/2753] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:30:02 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:30:02.743079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.753334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27618640-cc83-498d-90f5-2eaad395c201 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.758048 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.759257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.759639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.759981 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.760865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.762752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.773600 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1351/2754] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:30:02.778408 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.789114 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1522b0-0dcd-48a3-a3c1-18e95883d7df admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.794195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.795123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.795412 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.795695 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] PATH_INFO: `/v3/projects/3348827c7f23485c913d90396f7873a3/users/adcff7d921854f3ca8c9def6410780b4/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.810979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3348827c7f23485c913d90396f7873a3, user_id=adcff7d921854f3ca8c9def6410780b4, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.813665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.828060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1404/2755] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:30:02 2022] PUT /identity/v3/projects/3348827c7f23485c913d90396f7873a3/users/adcff7d921854f3ca8c9def6410780b4/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:30:02.831862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.842536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be56559-a45d-479f-b780-a0c5222c906b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.899996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1447e69-3707-4c00-aee4-664b7e89b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.900865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1447e69-3707-4c00-aee4-664b7e89b245 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.901137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1447e69-3707-4c00-aee4-664b7e89b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.901752 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1447e69-3707-4c00-aee4-664b7e89b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.902490 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1447e69-3707-4c00-aee4-664b7e89b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.904133 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1447e69-3707-4c00-aee4-664b7e89b245 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.916825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1352/2756] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:30:02.920995 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:02.932563 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4ecd-3e72-4e4b-ac39-02d253a958fa admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:02.937461 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:02.938320 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.938601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.938905 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] PATH_INFO: `/v3/projects/3348827c7f23485c913d90396f7873a3/users/adcff7d921854f3ca8c9def6410780b4/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.940877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3348827c7f23485c913d90396f7873a3, user_id=adcff7d921854f3ca8c9def6410780b4, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:02.943574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:02.955508 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1405/2757] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:30:02 2022] PUT /identity/v3/projects/3348827c7f23485c913d90396f7873a3/users/adcff7d921854f3ca8c9def6410780b4/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:02.966129 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:02.966563 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:02.966933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:02.996076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] MFA Rules not processed for user `adcff7d921854f3ca8c9def6410780b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:02.997565 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:03.083463 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1353/2758] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:30:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:30:03.091004 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:03.093442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:03.124685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:03.159334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390b12-e317-4cee-bfc6-7af7b4bcc395 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:03.163470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:03.164353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:03.165279 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:03.165936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:03.231814 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:03.233612 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:03.245115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1406/2759] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:30:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:30:04.787045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:04.788476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:04.800742 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b1e2d-3040-43b0-8f70-839525640627 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:04.804467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:04.805665 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:04.806656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:04.806656 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:04.865013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:04.866466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:04.876320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1354/2760] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:30:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:30:05.415361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:05.424289 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69290b1-8322-4abd-9e35-b6aa0d7664f9 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:05.427983 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf114c-f686-40bd-acb2-490f53047f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:05.428627 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf114c-f686-40bd-acb2-490f53047f0d service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:05.428914 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf114c-f686-40bd-acb2-490f53047f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:05.429195 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf114c-f686-40bd-acb2-490f53047f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:05.438911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf114c-f686-40bd-acb2-490f53047f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:05.440344 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf114c-f686-40bd-acb2-490f53047f0d service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:05.451862 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1407/2761] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:30:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:30:09.317514 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:09.323808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=100 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:09.380522 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e123b-9fd3-46d7-b0e7-d922f4440c5a service cinder] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:09.385000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:09.385859 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:09.386136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:09.386406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] PATH_INFO: `/v3/users/3a7e90f905684b20b8a7bf87426d8bca` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:09.387610 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7e90f905684b20b8a7bf87426d8bca)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:09.389518 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:09.435203 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7e90f905684b20b8a7bf87426d8bca'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:09.448676 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7e90f905684b20b8a7bf87426d8bca'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:09.449358 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7e90f905684b20b8a7bf87426d8bca'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:09.449961 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7e90f905684b20b8a7bf87426d8bca'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:09.456664 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7e90f905684b20b8a7bf87426d8bca'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:09.469205 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1355/2762] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:30:09 2022] DELETE /identity/v3/users/3a7e90f905684b20b8a7bf87426d8bca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:09.473679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:09.474164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:09.474290 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:09.492052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:30:09.493908 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:09.553885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1408/2763] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:30:09.564030 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:09.565436 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:09.621884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf41592-d905-41e0-bdb2-96301ea4f13e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:09.626291 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:09.627422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:09.627935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:09.628437 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:09.642271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:09.643754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:09.653714 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1356/2764] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:30:09.922922 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:09.924340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:09.938619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26709e-47eb-4959-b24c-46abdd5e88d7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:09.943350 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:09.944253 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:09.944530 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:09.944801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] PATH_INFO: `/v3/projects/bfbab252527441d581746b77e64f251c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:09.946016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbab252527441d581746b77e64f251c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:09.948206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:09.996135 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbab252527441d581746b77e64f251c', 'request_id': 'req-1122076c-ac3b-4d81-a9e1-7ae1e5801479'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.003104 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbab252527441d581746b77e64f251c', 'request_id': 'req-1122076c-ac3b-4d81-a9e1-7ae1e5801479'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.009745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbab252527441d581746b77e64f251c', 'request_id': 'req-1122076c-ac3b-4d81-a9e1-7ae1e5801479'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.010974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:10.022538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] The token cache is being invalidate because project bfbab252527441d581746b77e64f251c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:30:10.022912 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.024146 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.025682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1409/2765] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:30:09 2022] DELETE /identity/v3/projects/bfbab252527441d581746b77e64f251c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:10.029594 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:10.039820 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8729814-df2b-4805-a1db-bee147267fd1 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:10.064887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:10.099517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:10.100385 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:10.100658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:10.100930 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] PATH_INFO: `/v3/users/4b2a6a0d66af42798ab99b26b8e26e83` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:10.102137 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2a6a0d66af42798ab99b26b8e26e83)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:10.104099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:10.149993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2a6a0d66af42798ab99b26b8e26e83'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.161661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2a6a0d66af42798ab99b26b8e26e83'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.162324 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2a6a0d66af42798ab99b26b8e26e83'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.162952 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2a6a0d66af42798ab99b26b8e26e83'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.169795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2a6a0d66af42798ab99b26b8e26e83'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.183555 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1357/2766] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:30:10 2022] DELETE /identity/v3/users/4b2a6a0d66af42798ab99b26b8e26e83 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:10.449283 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:10.450732 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:10.465181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122076c-ac3b-4d81-a9e1-7ae1e5801479 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:10.524015 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:10.524950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:10.525162 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:10.525440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] PATH_INFO: `/v3/projects/b4fbba6cdcfc4f0b8240eb9282bcb866` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:10.526632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fbba6cdcfc4f0b8240eb9282bcb866)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:10.528588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:10.574149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fbba6cdcfc4f0b8240eb9282bcb866', 'request_id': 'req-bdc75241-f565-4093-a248-dcf249cf2156'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.581108 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fbba6cdcfc4f0b8240eb9282bcb866', 'request_id': 'req-bdc75241-f565-4093-a248-dcf249cf2156'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.587970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fbba6cdcfc4f0b8240eb9282bcb866', 'request_id': 'req-bdc75241-f565-4093-a248-dcf249cf2156'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.598053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] The token cache is being invalidate because project b4fbba6cdcfc4f0b8240eb9282bcb866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:30:10.598340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.599001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.600531 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1410/2767] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:30:10 2022] DELETE /identity/v3/projects/b4fbba6cdcfc4f0b8240eb9282bcb866 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:10.605229 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:10.606652 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:10.619590 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934789ca-728b-4976-8987-5878e2ce5c3d admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:10.687020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:10.687896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:10.688202 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:10.688483 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] PATH_INFO: `/v3/users/adcff7d921854f3ca8c9def6410780b4` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:10.689671 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adcff7d921854f3ca8c9def6410780b4)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:10.691680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:10.737623 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adcff7d921854f3ca8c9def6410780b4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.738766 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:10.752118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adcff7d921854f3ca8c9def6410780b4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.753768 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adcff7d921854f3ca8c9def6410780b4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.754399 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adcff7d921854f3ca8c9def6410780b4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.761770 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adcff7d921854f3ca8c9def6410780b4'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:10.774422 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1358/2768] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:30:10 2022] DELETE /identity/v3/users/adcff7d921854f3ca8c9def6410780b4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:30:11.046659 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:11.048130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:11.063136 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc75241-f565-4093-a248-dcf249cf2156 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:11.122021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:11.122915 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:11.123196 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:11.123470 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] PATH_INFO: `/v3/projects/3348827c7f23485c913d90396f7873a3` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:11.124666 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3348827c7f23485c913d90396f7873a3)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:11.126601 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:11.150587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:11.175324 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3348827c7f23485c913d90396f7873a3', 'request_id': 'req-eb45fb02-a412-4889-b174-807bae52dadb'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:11.182861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3348827c7f23485c913d90396f7873a3', 'request_id': 'req-eb45fb02-a412-4889-b174-807bae52dadb'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:11.189025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3348827c7f23485c913d90396f7873a3', 'request_id': 'req-eb45fb02-a412-4889-b174-807bae52dadb'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:11.200559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] The token cache is being invalidate because project 3348827c7f23485c913d90396f7873a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:30:11.200855 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:11.201496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:30:11.203093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1411/2769] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:30:11 2022] DELETE /identity/v3/projects/3348827c7f23485c913d90396f7873a3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:30:20.770354 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:21.197466 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:30:59.118268 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:30:59.119743 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:59.189938 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d12b22-fed7-42ac-a884-826dd70efa49 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:30:59.250216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d086ff-c6f0-4b12-ba99-2e097258fac3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:30:59.250909 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d086ff-c6f0-4b12-ba99-2e097258fac3 service placement] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:30:59.251196 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d086ff-c6f0-4b12-ba99-2e097258fac3 service placement] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:30:59.251474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d086ff-c6f0-4b12-ba99-2e097258fac3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:30:59.253312 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e8d086ff-c6f0-4b12-ba99-2e097258fac3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:30:59.265101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d086ff-c6f0-4b12-ba99-2e097258fac3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:30:59.266692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d086ff-c6f0-4b12-ba99-2e097258fac3 service placement] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:30:59.276562 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1359/2770] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:30:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:31:09.272321 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=58 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:41.976476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:41.977877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:42.033543 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45fb02-a412-4889-b174-807bae52dadb admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:42.037647 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:42.038280 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:42.038559 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:42.038869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:42.040608 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:42.097852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:42.099892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:42.113869 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1412/2771] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:31:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:31:45.680774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:45.681274 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:45.681382 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:45.698206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] MFA Rules not processed for user `b5c6ce36b61745a38e07b2f39b1d5a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:31:45.699423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:45.706162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1360/2772] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:31:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:31:52.104736 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=48 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:54.515263 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:54.516738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:54.572564 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19910f2-9459-4a1b-a9c4-fd5fae73dfc5 service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:54.576155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daef0b-19eb-496f-bdfa-afeb5d565eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:54.576792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daef0b-19eb-496f-bdfa-afeb5d565eee service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:54.577076 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daef0b-19eb-496f-bdfa-afeb5d565eee service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:54.577352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daef0b-19eb-496f-bdfa-afeb5d565eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:54.579212 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-93daef0b-19eb-496f-bdfa-afeb5d565eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:54.649903 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daef0b-19eb-496f-bdfa-afeb5d565eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:54.651361 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daef0b-19eb-496f-bdfa-afeb5d565eee service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:54.662116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1413/2773] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:31:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:31:55.693282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:31:55.831029 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:31:55.832433 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:55.845010 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650922-b670-4958-876d-7da8e338eec0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:31:55.848744 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:31:55.849544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:31:55.849699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:31:55.849955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:31:55.851703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:31:55.865432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:31:55.866933 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:31:55.877617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1361/2774] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:31:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:04.657321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=54 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:05.872901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=6 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:37.719557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d43c6-156b-495d-9597-3dc6fbe37c18 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:37.720090 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d43c6-156b-495d-9597-3dc6fbe37c18 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:37.720206 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d43c6-156b-495d-9597-3dc6fbe37c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:37.737897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-283d43c6-156b-495d-9597-3dc6fbe37c18 None None] MFA Rules not processed for user `25bf2b36b0ea472897721c924371ca95`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:32:37.739127 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-283d43c6-156b-495d-9597-3dc6fbe37c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:37.795288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1414/2775] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:32:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:32:38.412810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:38.414342 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:38.428579 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94857e0-665c-42c6-b79d-19e894ecb271 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:38.433699 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:38.434407 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:38.434782 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:38.435126 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:38.437046 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:38.450373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:38.452329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:38.462392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1362/2776] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:40.426641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d43c6-156b-495d-9597-3dc6fbe37c18 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:40.440945 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d43c6-156b-495d-9597-3dc6fbe37c18 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:40.446503 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:40.447476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:40.447985 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:40.448410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:40.451091 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:40.467367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:40.469002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:40.481997 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1415/2777] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:41.157480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:41.159691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:41.192334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24e3bc-f30e-434d-99a0-f13d6a781c02 service placement] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:41.208892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:41.209780 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:41.210406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:41.211020 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:41.214620 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:41.231814 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:41.234611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:41.251494 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1363/2778] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:49.073773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:32:49.075918 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:49.093304 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9c235-b32d-4565-9268-00060a09a47d service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:32:49.099161 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8c2616d20ea41f7ad4f953138f5636e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:32:49.099837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:32:49.100118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:32:49.100394 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:32:49.102167 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:32:49.115638 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:32:49.117237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:32:49.129467 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1416/2779] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:32:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:32:51.243696 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=12 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:32:59.124553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=37 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:50.797668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:50.807370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a5f89-c24b-4072-a2bb-637c7dae66e2 service nova] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:50.811858 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:50.812508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:50.812793 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:50.813073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:50.814922 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:50.878754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:50.880207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:50.890349 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1364/2780] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:33:57.628580 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.630123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:57.649099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5d9f6-98e3-4bcb-b855-f3c0bef32c33 service nova] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:57.654604 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:57.655968 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:57.656468 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:57.656846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] PATH_INFO: `/v3/users/b5c6ce36b61745a38e07b2f39b1d5a7b` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:57.658476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c6ce36b61745a38e07b2f39b1d5a7b)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:57.661128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:57.717934 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c6ce36b61745a38e07b2f39b1d5a7b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:57.736041 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c6ce36b61745a38e07b2f39b1d5a7b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:57.736701 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c6ce36b61745a38e07b2f39b1d5a7b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:57.737386 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c6ce36b61745a38e07b2f39b1d5a7b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:57.744667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c6ce36b61745a38e07b2f39b1d5a7b'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:57.759030 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1417/2781] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:33:57 2022] DELETE /identity/v3/users/b5c6ce36b61745a38e07b2f39b1d5a7b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:33:57.948160 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:57.981400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fddcd-7ed0-4095-845d-dec076f6f303 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.065703 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.066892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.067336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.067900 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] PATH_INFO: `/v3/projects/7cf1b6f5f2de4a079ddce00779fb67d3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.069234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf1b6f5f2de4a079ddce00779fb67d3)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.071500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.149864 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf1b6f5f2de4a079ddce00779fb67d3', 'request_id': 'req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.160821 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf1b6f5f2de4a079ddce00779fb67d3', 'request_id': 'req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.171690 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf1b6f5f2de4a079ddce00779fb67d3', 'request_id': 'req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.186178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] The token cache is being invalidate because project 7cf1b6f5f2de4a079ddce00779fb67d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:33:58.186533 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.190426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.192658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1365/2782] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:33:57 2022] DELETE /identity/v3/projects/7cf1b6f5f2de4a079ddce00779fb67d3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:33:58.198080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.199773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:58.217194 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d29ac-f9cd-4749-905c-374c75c4b62c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.291171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.292083 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.292368 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.292646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] PATH_INFO: `/v3/users/f0e8578a142e4a2f9b9015338e4dfe37` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.293850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e8578a142e4a2f9b9015338e4dfe37)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.296598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.347967 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e8578a142e4a2f9b9015338e4dfe37'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.361984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e8578a142e4a2f9b9015338e4dfe37'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.362877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e8578a142e4a2f9b9015338e4dfe37'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.363574 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e8578a142e4a2f9b9015338e4dfe37'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.370738 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e8578a142e4a2f9b9015338e4dfe37'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.372694 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.386676 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1418/2783] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:33:58 2022] DELETE /identity/v3/users/f0e8578a142e4a2f9b9015338e4dfe37 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:33:58.579916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:33:58.581415 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:33:58.597346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea1462-388f-43cf-8902-cd2e3b6fec9e admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:33:58.622329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:33:58.664500 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:33:58.665394 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:33:58.665673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:33:58.665965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] PATH_INFO: `/v3/projects/7824505946a2487e98958bdbd78ee180` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:33:58.667276 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7824505946a2487e98958bdbd78ee180)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:33:58.669230 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:33:58.720216 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7824505946a2487e98958bdbd78ee180', 'request_id': 'req-afdb2184-84f7-48d7-9da4-6fe8e11c6660'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.729628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7824505946a2487e98958bdbd78ee180', 'request_id': 'req-afdb2184-84f7-48d7-9da4-6fe8e11c6660'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.739200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7824505946a2487e98958bdbd78ee180', 'request_id': 'req-afdb2184-84f7-48d7-9da4-6fe8e11c6660'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.754801 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] The token cache is being invalidate because project 7824505946a2487e98958bdbd78ee180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:33:58.755099 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.755756 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:33:58.757348 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1366/2784] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:33:58 2022] DELETE /identity/v3/projects/7824505946a2487e98958bdbd78ee180 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:00.676340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:00.677881 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:00.691100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d2b1b-b63b-4139-af94-fcb1a8a6983e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:00.750517 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:00.751333 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:00.751618 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:00.751893 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] PATH_INFO: `/v3/users/25bf2b36b0ea472897721c924371ca95` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:00.753092 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bf2b36b0ea472897721c924371ca95)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:00.755069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:00.806626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bf2b36b0ea472897721c924371ca95'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:00.818241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bf2b36b0ea472897721c924371ca95'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:00.818939 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bf2b36b0ea472897721c924371ca95'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:00.819539 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bf2b36b0ea472897721c924371ca95'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:00.826989 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-3f317c3a-0ab6-4cd5-90a0-e3480494ac33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bf2b36b0ea472897721c924371ca95'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:00.840254 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1419/2785] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:00 2022] DELETE /identity/v3/users/25bf2b36b0ea472897721c924371ca95 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:01.011084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.013084 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.027865 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb2184-84f7-48d7-9da4-6fe8e11c6660 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.096498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.097409 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.097691 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.097965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] PATH_INFO: `/v3/projects/6b5693ab060c4dc98949c1e9cf1a331a` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.099207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5693ab060c4dc98949c1e9cf1a331a)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.101140 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.151523 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5693ab060c4dc98949c1e9cf1a331a', 'request_id': 'req-87da2e07-9b00-4038-b820-ea917d97eeae'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:01.159225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5693ab060c4dc98949c1e9cf1a331a', 'request_id': 'req-87da2e07-9b00-4038-b820-ea917d97eeae'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:01.160357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:01.168428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5693ab060c4dc98949c1e9cf1a331a', 'request_id': 'req-87da2e07-9b00-4038-b820-ea917d97eeae'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:01.179414 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] The token cache is being invalidate because project 6b5693ab060c4dc98949c1e9cf1a331a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:01.179702 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:01.180336 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-87da2e07-9b00-4038-b820-ea917d97eeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:01.181878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1367/2786] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:01 2022] DELETE /identity/v3/projects/6b5693ab060c4dc98949c1e9cf1a331a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:01.186998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed9cd1-cb92-4485-8a35-4ca22af14c6b None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.187292 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed9cd1-cb92-4485-8a35-4ca22af14c6b None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.187572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed9cd1-cb92-4485-8a35-4ca22af14c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.204897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-b3ed9cd1-cb92-4485-8a35-4ca22af14c6b None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:01.206134 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-b3ed9cd1-cb92-4485-8a35-4ca22af14c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.265139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1420/2787] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:01.273013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607016ee-5913-47dd-b4e1-6f0e7c390cb0 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.273304 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607016ee-5913-47dd-b4e1-6f0e7c390cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.273613 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607016ee-5913-47dd-b4e1-6f0e7c390cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.292021 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-607016ee-5913-47dd-b4e1-6f0e7c390cb0 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:01.293221 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-607016ee-5913-47dd-b4e1-6f0e7c390cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.301788 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1368/2788] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:34:01.306011 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed9cd1-cb92-4485-8a35-4ca22af14c6b None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.315740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed9cd1-cb92-4485-8a35-4ca22af14c6b None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.320326 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.320999 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.321281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.321556 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.322533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:01.322872 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.324452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.331074 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:01.338879 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1421/2789] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:01.343867 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607016ee-5913-47dd-b4e1-6f0e7c390cb0 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.353047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607016ee-5913-47dd-b4e1-6f0e7c390cb0 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.358326 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.359000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.359284 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.359561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.360323 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.362213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.387853 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1369/2790] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:01.392524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.402558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92479-77c8-4a6e-8709-b7aa6a2c8ad4 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.459139 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.459961 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.460255 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.460541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.461239 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.463181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.482924 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1422/2791] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:01.487207 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.497575 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31891212-87be-405f-9ab7-24598e9f1f0b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.502615 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.503330 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.503617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.503891 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.504596 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.506192 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.516970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1370/2792] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:01.520761 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.530739 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a18f7a-53a8-4305-a38a-c6bdb0fe9aed admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.535419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87a258-7cdf-40ef-992c-ed358190a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.536067 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87a258-7cdf-40ef-992c-ed358190a26f admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.536352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87a258-7cdf-40ef-992c-ed358190a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.536629 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87a258-7cdf-40ef-992c-ed358190a26f admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.537353 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87a258-7cdf-40ef-992c-ed358190a26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.538963 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87a258-7cdf-40ef-992c-ed358190a26f admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.549179 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1423/2793] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:01.553328 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.564121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977288b-f0ca-429b-8f52-d4db795b8ad3 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.568685 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.569546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.569825 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.570093 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] PATH_INFO: `/v3/projects/b85819cd178e41ae898157267a15fda3/users/d640fe8cb11f47608fd859bc38435905/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.584888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85819cd178e41ae898157267a15fda3, user_id=d640fe8cb11f47608fd859bc38435905, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.587544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.599912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1371/2794] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:01 2022] PUT /identity/v3/projects/b85819cd178e41ae898157267a15fda3/users/d640fe8cb11f47608fd859bc38435905/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:01.611157 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149033f2-b1b9-4728-aac3-d5fa42424334 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.611534 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149033f2-b1b9-4728-aac3-d5fa42424334 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.611902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149033f2-b1b9-4728-aac3-d5fa42424334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.638586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-149033f2-b1b9-4728-aac3-d5fa42424334 None None] MFA Rules not processed for user `d640fe8cb11f47608fd859bc38435905`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:01.639840 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-149033f2-b1b9-4728-aac3-d5fa42424334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.703440 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1424/2795] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:01.713991 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:01.715663 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:01.772863 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee2a66-cc06-4b3c-b8f4-d0c9037b6b40 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:01.776507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d4e39-78ae-4946-aeb7-71c068cf3525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:01.777181 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d4e39-78ae-4946-aeb7-71c068cf3525 service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:01.777493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d4e39-78ae-4946-aeb7-71c068cf3525 service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:01.777774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d4e39-78ae-4946-aeb7-71c068cf3525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:01.786384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d4e39-78ae-4946-aeb7-71c068cf3525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:01.787878 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d4e39-78ae-4946-aeb7-71c068cf3525 service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:01.797250 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1372/2796] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:10.014149 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149033f2-b1b9-4728-aac3-d5fa42424334 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.075079 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149033f2-b1b9-4728-aac3-d5fa42424334 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.080168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:10.081024 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.081310 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.081591 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] PATH_INFO: `/v3/users/d640fe8cb11f47608fd859bc38435905` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.082810 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d640fe8cb11f47608fd859bc38435905)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:10.084730 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:10.090016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:10.130602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd640fe8cb11f47608fd859bc38435905'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.142926 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd640fe8cb11f47608fd859bc38435905'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.143597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd640fe8cb11f47608fd859bc38435905'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.144216 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd640fe8cb11f47608fd859bc38435905'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.151257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd640fe8cb11f47608fd859bc38435905'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.164637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1425/2797] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:10 2022] DELETE /identity/v3/users/d640fe8cb11f47608fd859bc38435905 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:10.169193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.169680 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.169806 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.187079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:10.188271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:10.245488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1373/2798] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:10.255561 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.256979 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:10.313495 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8d35f-9d10-4fcc-ab9d-914b4dc0ab8e admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.317190 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757ca10-cd3c-4974-ae1e-d659f1d21112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:10.317826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ca10-cd3c-4974-ae1e-d659f1d21112 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.318116 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ca10-cd3c-4974-ae1e-d659f1d21112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.318399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ca10-cd3c-4974-ae1e-d659f1d21112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.328168 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757ca10-cd3c-4974-ae1e-d659f1d21112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:10.329595 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757ca10-cd3c-4974-ae1e-d659f1d21112 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:10.339937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1426/2799] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:10.610092 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.611547 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:10.623306 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28fc5e-4dc9-44f1-934d-c3380dc9bfee None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.630103 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:10.631892 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.632194 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.632478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] PATH_INFO: `/v3/projects/b85819cd178e41ae898157267a15fda3` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.633872 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85819cd178e41ae898157267a15fda3)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:10.636005 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:10.659923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:10.687525 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85819cd178e41ae898157267a15fda3', 'request_id': 'req-bc9ba927-4448-4a91-bd55-5d964030e116'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.695028 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85819cd178e41ae898157267a15fda3', 'request_id': 'req-bc9ba927-4448-4a91-bd55-5d964030e116'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.701595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85819cd178e41ae898157267a15fda3', 'request_id': 'req-bc9ba927-4448-4a91-bd55-5d964030e116'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.712705 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] The token cache is being invalidate because project b85819cd178e41ae898157267a15fda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:10.712993 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.713627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-bc9ba927-4448-4a91-bd55-5d964030e116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:10.715251 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1374/2800] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:10 2022] DELETE /identity/v3/projects/b85819cd178e41ae898157267a15fda3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:10.720586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c36ad-8cfb-47da-a145-ea2c3ce0d526 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.720882 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c36ad-8cfb-47da-a145-ea2c3ce0d526 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.721165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c36ad-8cfb-47da-a145-ea2c3ce0d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.739021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-ed1c36ad-8cfb-47da-a145-ea2c3ce0d526 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:10.740221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ed1c36ad-8cfb-47da-a145-ea2c3ce0d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:10.800557 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1427/2801] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:10.808346 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae58d-7cf0-425b-887a-defdab37f839 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.808643 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae58d-7cf0-425b-887a-defdab37f839 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.808925 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae58d-7cf0-425b-887a-defdab37f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.834102 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-46fae58d-7cf0-425b-887a-defdab37f839 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:10.835502 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-46fae58d-7cf0-425b-887a-defdab37f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:10.843397 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1375/2802] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:10.847636 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c36ad-8cfb-47da-a145-ea2c3ce0d526 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.857339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c36ad-8cfb-47da-a145-ea2c3ce0d526 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.862571 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:10.863246 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.863532 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.863808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.864524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:10.864832 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:10.866416 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:10.878399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1428/2803] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:10.882587 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae58d-7cf0-425b-887a-defdab37f839 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.891644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae58d-7cf0-425b-887a-defdab37f839 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.896374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:10.897039 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:10.897322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:10.897595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:10.898277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:10.900219 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:10.926190 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1376/2804] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:10 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:10.931144 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:10.943951 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05ce4d-79e3-44e2-8a16-d24a34d738cc admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:10.957017 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:11.003547 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.004207 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.004491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.004782 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.005459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.007398 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.027057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1429/2805] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:10 2022] POST /identity/v3/users => generated 278 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:11.031649 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.041658 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711122b-82d5-41c2-9b02-d884919323b9 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.047175 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.047830 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.048110 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.048379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.049123 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.050789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.061132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1377/2806] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:11.064798 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.075057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cd53f-a697-4d87-8d9d-64be34849dd2 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.080070 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def45e7-fdf2-46d2-ae9d-e4a319a19591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.080720 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def45e7-fdf2-46d2-ae9d-e4a319a19591 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.081020 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def45e7-fdf2-46d2-ae9d-e4a319a19591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.081297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def45e7-fdf2-46d2-ae9d-e4a319a19591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.082036 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def45e7-fdf2-46d2-ae9d-e4a319a19591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.083704 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def45e7-fdf2-46d2-ae9d-e4a319a19591 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.094950 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1430/2807] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:11.098949 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.109492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0733e2d-b1e8-4fdd-bebe-b023eb7b271a admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.114374 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.115294 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.115573 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.115846 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] PATH_INFO: `/v3/projects/f9fc44b6df9045e09ba734b9af2cd1fb/users/1b33540e512c48c5b89174ff45e3c014/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.130619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9fc44b6df9045e09ba734b9af2cd1fb, user_id=1b33540e512c48c5b89174ff45e3c014, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.133295 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.146047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1378/2808] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:11 2022] PUT /identity/v3/projects/f9fc44b6df9045e09ba734b9af2cd1fb/users/1b33540e512c48c5b89174ff45e3c014/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:11.156884 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b47a1-5e4e-4f55-b2d7-596950c11f1e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.157171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b47a1-5e4e-4f55-b2d7-596950c11f1e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.157444 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b47a1-5e4e-4f55-b2d7-596950c11f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.184842 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-493b47a1-5e4e-4f55-b2d7-596950c11f1e None None] MFA Rules not processed for user `1b33540e512c48c5b89174ff45e3c014`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:11.186029 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-493b47a1-5e4e-4f55-b2d7-596950c11f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:11.249970 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1431/2809] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:11 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:11.254488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.323076 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d258-8e25-4d64-b986-00f292ff5210 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.328286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.328939 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.329225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.329503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.330199 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.332136 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.357498 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1379/2810] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:11 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:11.361804 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b47a1-5e4e-4f55-b2d7-596950c11f1e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.372339 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b47a1-5e4e-4f55-b2d7-596950c11f1e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.427570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.428232 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.428518 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.428797 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.429497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.431465 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.451099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1432/2811] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:11 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:11.455544 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.465869 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da57c9-9f7b-4b8f-a1dd-9c64380680af admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.471130 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.471785 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.472075 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.472355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.473079 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.474755 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.485557 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1380/2812] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:11.490025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.499586 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687dd8f-5310-4898-a11c-83aad39f8fbe admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.504261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.505132 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.505422 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.505699 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] PATH_INFO: `/v3/projects/2a0b8f950281454bbdfa04d7765bd7a5/users/80dcc2b8f64645f0a963a78c5a1d0ea8/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.518562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:11.523165 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0b8f950281454bbdfa04d7765bd7a5, user_id=80dcc2b8f64645f0a963a78c5a1d0ea8, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.526397 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.544572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1433/2813] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:11 2022] PUT /identity/v3/projects/2a0b8f950281454bbdfa04d7765bd7a5/users/80dcc2b8f64645f0a963a78c5a1d0ea8/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:11.548627 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.559002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c3d1b-7df1-4e0b-aebb-31341b532d99 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.571206 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:11.617834 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9919db-4e9e-4f1c-86f0-2db591758824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.618420 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9919db-4e9e-4f1c-86f0-2db591758824 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.618732 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9919db-4e9e-4f1c-86f0-2db591758824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.619016 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9919db-4e9e-4f1c-86f0-2db591758824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.619737 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9919db-4e9e-4f1c-86f0-2db591758824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.621339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9919db-4e9e-4f1c-86f0-2db591758824 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.630941 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1381/2814] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:11.635587 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.648211 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3410-05a0-450a-aeff-03ba3da33e56 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.653230 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.654184 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.654471 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.654781 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] PATH_INFO: `/v3/projects/2a0b8f950281454bbdfa04d7765bd7a5/users/80dcc2b8f64645f0a963a78c5a1d0ea8/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.657588 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0b8f950281454bbdfa04d7765bd7a5, user_id=80dcc2b8f64645f0a963a78c5a1d0ea8, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.660274 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.672219 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1434/2815] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:11 2022] PUT /identity/v3/projects/2a0b8f950281454bbdfa04d7765bd7a5/users/80dcc2b8f64645f0a963a78c5a1d0ea8/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:11.683682 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7048ba9-cd63-4cbb-828d-9d213a4f0259 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.683974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7048ba9-cd63-4cbb-828d-9d213a4f0259 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.684361 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7048ba9-cd63-4cbb-828d-9d213a4f0259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.711767 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-b7048ba9-cd63-4cbb-828d-9d213a4f0259 None None] MFA Rules not processed for user `80dcc2b8f64645f0a963a78c5a1d0ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:11.712977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-b7048ba9-cd63-4cbb-828d-9d213a4f0259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:11.780908 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1382/2816] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:11 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:11.792276 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.794009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:11.849851 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dbfb4-3d46-422f-ba6f-8e92c8395d76 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.853568 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.854199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.854484 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.854792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:11.863826 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:11.865241 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:11.875129 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1435/2817] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:11.946185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7048ba9-cd63-4cbb-828d-9d213a4f0259 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:11.956760 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7048ba9-cd63-4cbb-828d-9d213a4f0259 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:11.960450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebda62-65a5-4e1e-bd37-5fe7198831bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:11.961108 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebda62-65a5-4e1e-bd37-5fe7198831bc service cinder] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:11.961377 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebda62-65a5-4e1e-bd37-5fe7198831bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:11.961657 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebda62-65a5-4e1e-bd37-5fe7198831bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:12.017065 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebda62-65a5-4e1e-bd37-5fe7198831bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:12.018512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebda62-65a5-4e1e-bd37-5fe7198831bc service cinder] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:12.027355 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1383/2818] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:11 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:21.870542 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=35,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:22.023508 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=83 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:26.671221 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:26.781298 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8263-f787-48ec-ace7-ed7ed6b96c1b service cinder] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:26.785984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:26.786889 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:26.787177 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:26.787457 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] PATH_INFO: `/v3/users/1b33540e512c48c5b89174ff45e3c014` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:26.788682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b33540e512c48c5b89174ff45e3c014)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:26.790597 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:26.837756 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b33540e512c48c5b89174ff45e3c014'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:26.849620 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b33540e512c48c5b89174ff45e3c014'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:26.850299 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b33540e512c48c5b89174ff45e3c014'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:26.850937 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b33540e512c48c5b89174ff45e3c014'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:26.857682 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b33540e512c48c5b89174ff45e3c014'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:26.871317 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1436/2819] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:26 2022] DELETE /identity/v3/users/1b33540e512c48c5b89174ff45e3c014 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:26.877499 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:26.878013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:26.878301 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:26.925400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:26.926532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:26.983442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1384/2820] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:26.993686 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:26.995123 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:27.036315 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:27.096497 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb0c3b-a035-40c5-9c6f-85b63d8b4e5d admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:27.100228 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:27.100877 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:27.101164 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:27.101445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:27.111558 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:27.112988 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:27.122450 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1437/2821] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:27.390644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:27.392210 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:27.404285 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd122b-33ea-42d0-aa81-e5a0534ec0b3 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:27.410071 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:27.410960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:27.411247 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:27.411550 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] PATH_INFO: `/v3/projects/f9fc44b6df9045e09ba734b9af2cd1fb` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:27.412718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9fc44b6df9045e09ba734b9af2cd1fb)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:27.414648 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:27.462334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9fc44b6df9045e09ba734b9af2cd1fb', 'request_id': 'req-52e69d75-f692-4307-bbf2-eba20430c696'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.469496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9fc44b6df9045e09ba734b9af2cd1fb', 'request_id': 'req-52e69d75-f692-4307-bbf2-eba20430c696'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.476826 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9fc44b6df9045e09ba734b9af2cd1fb', 'request_id': 'req-52e69d75-f692-4307-bbf2-eba20430c696'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.487980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] The token cache is being invalidate because project f9fc44b6df9045e09ba734b9af2cd1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:27.488275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.488960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.490862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1385/2822] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:27 2022] DELETE /identity/v3/projects/f9fc44b6df9045e09ba734b9af2cd1fb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:27.494598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:27.504456 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405bbf2-f31c-4b7a-a778-6ea607a2abd5 service neutron] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:27.559370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:27.560237 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:27.560524 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:27.560806 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] PATH_INFO: `/v3/users/80dcc2b8f64645f0a963a78c5a1d0ea8` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:27.561991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80dcc2b8f64645f0a963a78c5a1d0ea8)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:27.563971 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:27.607698 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80dcc2b8f64645f0a963a78c5a1d0ea8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.619917 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80dcc2b8f64645f0a963a78c5a1d0ea8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.620579 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80dcc2b8f64645f0a963a78c5a1d0ea8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.621259 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80dcc2b8f64645f0a963a78c5a1d0ea8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.628151 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-b4c0804d-fbce-4367-bd2d-42d2f42e18f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80dcc2b8f64645f0a963a78c5a1d0ea8'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:27.640871 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1438/2823] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:27 2022] DELETE /identity/v3/users/80dcc2b8f64645f0a963a78c5a1d0ea8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:34:27.912369 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:27.913966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:27.927774 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69d75-f692-4307-bbf2-eba20430c696 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:27.981451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:27.988466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:27.989739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:27.990087 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:27.990569 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] PATH_INFO: `/v3/projects/2a0b8f950281454bbdfa04d7765bd7a5` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:27.992170 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0b8f950281454bbdfa04d7765bd7a5)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:27.994083 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.039488 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0b8f950281454bbdfa04d7765bd7a5', 'request_id': 'req-2ff3b078-d644-4d95-b86c-d7e60ce9098d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:28.047718 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0b8f950281454bbdfa04d7765bd7a5', 'request_id': 'req-2ff3b078-d644-4d95-b86c-d7e60ce9098d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:28.054338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0b8f950281454bbdfa04d7765bd7a5', 'request_id': 'req-2ff3b078-d644-4d95-b86c-d7e60ce9098d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:28.069603 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] The token cache is being invalidate because project 2a0b8f950281454bbdfa04d7765bd7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:28.069890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:28.070546 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-2ff3b078-d644-4d95-b86c-d7e60ce9098d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:28.072117 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1386/2824] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:27 2022] DELETE /identity/v3/projects/2a0b8f950281454bbdfa04d7765bd7a5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:28.077308 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3924b0-802b-45e7-a101-bb22afd329b4 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.077830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3924b0-802b-45e7-a101-bb22afd329b4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.077935 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3924b0-802b-45e7-a101-bb22afd329b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.110535 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:28.127685 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1f3924b0-802b-45e7-a101-bb22afd329b4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:28.128875 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1f3924b0-802b-45e7-a101-bb22afd329b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:28.188085 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1439/2825] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:28.195797 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e097ea-c1b2-4aa4-8cba-d6f70dc6ff8e None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.196090 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e097ea-c1b2-4aa4-8cba-d6f70dc6ff8e None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.196373 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e097ea-c1b2-4aa4-8cba-d6f70dc6ff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.214668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-27e097ea-c1b2-4aa4-8cba-d6f70dc6ff8e None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:28.215904 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-27e097ea-c1b2-4aa4-8cba-d6f70dc6ff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:28.224451 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1387/2826] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:28.228584 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3924b0-802b-45e7-a101-bb22afd329b4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.238861 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3924b0-802b-45e7-a101-bb22afd329b4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.243624 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.244201 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.244490 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.244767 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.245496 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80025) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:28.245807 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.247452 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.259236 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1440/2827] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:28.263611 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e097ea-c1b2-4aa4-8cba-d6f70dc6ff8e None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.272818 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e097ea-c1b2-4aa4-8cba-d6f70dc6ff8e None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.277862 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.278507 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.278824 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.279106 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.279795 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.281693 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.307303 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1388/2828] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:28 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:28.311546 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.321288 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b68101-9408-4917-99ce-b000b9203b43 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.381073 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.381746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.382031 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.382309 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.383028 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.384936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.408301 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1441/2829] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:28 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:28.412466 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.423070 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c7eb-875c-46d8-9492-7f62cdea2336 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.427810 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.428512 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.428797 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.429073 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.429794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.431464 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.442625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1389/2830] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:28.446573 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.457445 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73912f1b-8b3b-4b1b-ac96-9adb06f04df8 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.462056 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe001-ebd6-40f0-b3a2-d62d1332ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.462763 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe001-ebd6-40f0-b3a2-d62d1332ee3b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.463050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe001-ebd6-40f0-b3a2-d62d1332ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.463322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe001-ebd6-40f0-b3a2-d62d1332ee3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.464071 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe001-ebd6-40f0-b3a2-d62d1332ee3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.465641 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe001-ebd6-40f0-b3a2-d62d1332ee3b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.478130 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1442/2831] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:34:28.479595 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.491208 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2f0a-fa03-4b88-b73b-8d76bcdcb823 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.495919 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.496733 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.497007 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.497277 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] PATH_INFO: `/v3/projects/f0b1d2641f804e8b9d5cd554011335bc/users/800d4ae5b15b4bd89cd8607cb1af9c26/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.512476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b1d2641f804e8b9d5cd554011335bc, user_id=800d4ae5b15b4bd89cd8607cb1af9c26, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.515169 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.528405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1390/2832] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:28 2022] PUT /identity/v3/projects/f0b1d2641f804e8b9d5cd554011335bc/users/800d4ae5b15b4bd89cd8607cb1af9c26/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:28.540609 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3aff-cbeb-46d2-b355-74d1c0eb2a3e None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.540897 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3aff-cbeb-46d2-b355-74d1c0eb2a3e None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.541175 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b3aff-cbeb-46d2-b355-74d1c0eb2a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.567419 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1f8b3aff-cbeb-46d2-b355-74d1c0eb2a3e None None] MFA Rules not processed for user `800d4ae5b15b4bd89cd8607cb1af9c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:28.568692 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1f8b3aff-cbeb-46d2-b355-74d1c0eb2a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:28.623880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:28.633771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1443/2833] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:28.638227 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.700370 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c5c4-cd9d-4bc8-b482-2325019a9a60 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.705570 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.706224 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.706503 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.706802 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.707496 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.709403 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.734646 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1391/2834] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:28 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:28.738589 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b3aff-cbeb-46d2-b355-74d1c0eb2a3e None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.749402 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b3aff-cbeb-46d2-b355-74d1c0eb2a3e None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.804337 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.804998 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.805294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.805553 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] PATH_INFO: `/v3/users` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.806243 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.808172 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.828830 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1444/2835] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:28 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:28.833282 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.843708 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba67c75-6342-4f3a-8c92-b138f0dcad61 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.848868 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.849515 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.849796 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.850066 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.850903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.853542 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.855706 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:28.868121 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1392/2836] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:28.872100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.882833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391601ae-0e3a-4640-ae9a-2497afe89bfd admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.887492 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.888370 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.888655 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.888936 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] PATH_INFO: `/v3/projects/dba04430775b4c388ebc6d58464af16a/users/f7f5053a6e4c4ba8a9eb954ad049f918/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.904626 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba04430775b4c388ebc6d58464af16a, user_id=f7f5053a6e4c4ba8a9eb954ad049f918, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.907469 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:28.920186 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1445/2837] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:28 2022] PUT /identity/v3/projects/dba04430775b4c388ebc6d58464af16a/users/f7f5053a6e4c4ba8a9eb954ad049f918/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:28.924132 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:28.934486 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749a16-9ad6-45fc-bee1-7547cfc488e5 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:28.990951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edd608-a7de-410f-a559-6a2f68805992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:28.991644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edd608-a7de-410f-a559-6a2f68805992 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:28.991951 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edd608-a7de-410f-a559-6a2f68805992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:28.992225 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edd608-a7de-410f-a559-6a2f68805992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:28.992956 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edd608-a7de-410f-a559-6a2f68805992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:28.994711 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edd608-a7de-410f-a559-6a2f68805992 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:29.005308 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1393/2838] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:29.009323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:29.020307 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39624695-9077-432d-8a1b-521c2b93fcde admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:29.024987 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:29.025857 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:29.026143 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:29.026418 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] PATH_INFO: `/v3/projects/dba04430775b4c388ebc6d58464af16a/users/f7f5053a6e4c4ba8a9eb954ad049f918/roles/cf54c1867a54448f8977c8d3d9494b48` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:29.028442 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba04430775b4c388ebc6d58464af16a, user_id=f7f5053a6e4c4ba8a9eb954ad049f918, role_id=cf54c1867a54448f8977c8d3d9494b48)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:29.031233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:29.041261 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1446/2839] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:29 2022] PUT /identity/v3/projects/dba04430775b4c388ebc6d58464af16a/users/f7f5053a6e4c4ba8a9eb954ad049f918/roles/cf54c1867a54448f8977c8d3d9494b48 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:29.051157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7da8ff-ef49-4160-aa43-67efae36d075 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:29.051444 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7da8ff-ef49-4160-aa43-67efae36d075 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:29.051717 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7da8ff-ef49-4160-aa43-67efae36d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:29.077808 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-6b7da8ff-ef49-4160-aa43-67efae36d075 None None] MFA Rules not processed for user `f7f5053a6e4c4ba8a9eb954ad049f918`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:29.079034 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-6b7da8ff-ef49-4160-aa43-67efae36d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:29.145757 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1394/2840] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:29.156637 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:29.158355 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:29.214516 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbcce1-4176-4224-985c-0445852f6e42 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:29.218378 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ce9a5-084d-46d4-bbfd-5c72888f78e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:29.219050 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ce9a5-084d-46d4-bbfd-5c72888f78e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:29.219338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ce9a5-084d-46d4-bbfd-5c72888f78e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:29.219619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ce9a5-084d-46d4-bbfd-5c72888f78e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:29.228710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ce9a5-084d-46d4-bbfd-5c72888f78e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:29.230131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ce9a5-084d-46d4-bbfd-5c72888f78e1 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:29.240160 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1447/2841] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:29.269138 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7da8ff-ef49-4160-aa43-67efae36d075 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:29.330114 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7da8ff-ef49-4160-aa43-67efae36d075 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:29.334794 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:29.335659 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:29.335998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:29.336252 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] PATH_INFO: `/v3/users/800d4ae5b15b4bd89cd8607cb1af9c26` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:29.337548 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=800d4ae5b15b4bd89cd8607cb1af9c26)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:29.339493 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:29.361561 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:29.386474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800d4ae5b15b4bd89cd8607cb1af9c26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.398116 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800d4ae5b15b4bd89cd8607cb1af9c26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.398833 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800d4ae5b15b4bd89cd8607cb1af9c26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.399459 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800d4ae5b15b4bd89cd8607cb1af9c26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.406234 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800d4ae5b15b4bd89cd8607cb1af9c26'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.419829 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1395/2842] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:29 2022] DELETE /identity/v3/users/800d4ae5b15b4bd89cd8607cb1af9c26 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:29.424876 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:29.425250 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:29.425533 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:29.443485 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:29.444665 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:29.497375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:29.513185 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1448/2843] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:29.522998 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:29.524400 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:29.581423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca933484-cac3-44e6-b4c6-ef392d6df61b admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:29.585053 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:29.585688 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:29.585969 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:29.586241 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:29.595101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:29.597044 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:29.606338 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1396/2844] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:29.871100 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:29.872528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:29.887093 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464c2ab-bb67-418e-ac9d-803644520511 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:29.892155 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:29.893027 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:29.893311 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:29.893582 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] PATH_INFO: `/v3/projects/f0b1d2641f804e8b9d5cd554011335bc` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:29.894820 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b1d2641f804e8b9d5cd554011335bc)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:29.896788 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:29.943323 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b1d2641f804e8b9d5cd554011335bc', 'request_id': 'req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.950852 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b1d2641f804e8b9d5cd554011335bc', 'request_id': 'req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.957705 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b1d2641f804e8b9d5cd554011335bc', 'request_id': 'req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.968052 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] The token cache is being invalidate because project f0b1d2641f804e8b9d5cd554011335bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:29.968341 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.969005 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:29.971316 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1449/2845] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:29 2022] DELETE /identity/v3/projects/f0b1d2641f804e8b9d5cd554011335bc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:29.975314 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:29.985094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3306e-988b-480d-af63-fc1d3cd93b01 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.040310 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.041171 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.041452 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.041725 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] PATH_INFO: `/v3/users/f7f5053a6e4c4ba8a9eb954ad049f918` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.042916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f5053a6e4c4ba8a9eb954ad049f918)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.044849 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.088178 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:30.090912 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f5053a6e4c4ba8a9eb954ad049f918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.104609 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f5053a6e4c4ba8a9eb954ad049f918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.105281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f5053a6e4c4ba8a9eb954ad049f918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.105886 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f5053a6e4c4ba8a9eb954ad049f918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.112639 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-35f7f9bb-57b9-45fd-94fc-73ee2466a3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f5053a6e4c4ba8a9eb954ad049f918'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.124779 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1397/2846] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:29 2022] DELETE /identity/v3/users/f7f5053a6e4c4ba8a9eb954ad049f918 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:30.406426 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.409606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:30.427848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7b92-1f46-4b0d-b2b8-e27c6a6c3b55 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.485528 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.487040 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.487327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.487745 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] PATH_INFO: `/v3/projects/dba04430775b4c388ebc6d58464af16a` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.489062 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba04430775b4c388ebc6d58464af16a)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.491049 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.538364 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba04430775b4c388ebc6d58464af16a', 'request_id': 'req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.549078 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba04430775b4c388ebc6d58464af16a', 'request_id': 'req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.556199 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba04430775b4c388ebc6d58464af16a', 'request_id': 'req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.567322 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] The token cache is being invalidate because project dba04430775b4c388ebc6d58464af16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:30.567613 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.568275 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-8f5a0670-0fa0-43b8-8185-431a9f12ffd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:30.569845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1450/2847] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:30 2022] DELETE /identity/v3/projects/dba04430775b4c388ebc6d58464af16a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:30.575120 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033b53-3cbb-49cb-9ba6-71ec51bced2f None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.575430 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033b53-3cbb-49cb-9ba6-71ec51bced2f None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.575710 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033b53-3cbb-49cb-9ba6-71ec51bced2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.595213 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-d6033b53-3cbb-49cb-9ba6-71ec51bced2f None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:30.596450 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-d6033b53-3cbb-49cb-9ba6-71ec51bced2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:30.676405 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1398/2848] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:30.684764 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425deca-d83f-468e-83d3-51e174b799c7 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.685046 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425deca-d83f-468e-83d3-51e174b799c7 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.685329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425deca-d83f-468e-83d3-51e174b799c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.693335 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:30.708683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-e425deca-d83f-468e-83d3-51e174b799c7 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:30.709909 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e425deca-d83f-468e-83d3-51e174b799c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:30.718181 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1451/2849] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:30.722669 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6033b53-3cbb-49cb-9ba6-71ec51bced2f None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.732539 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6033b53-3cbb-49cb-9ba6-71ec51bced2f None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.738122 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.738804 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.739086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.739357 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.740088 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:30.740392 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.742000 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.755320 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1399/2850] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 10:34:30.759816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425deca-d83f-468e-83d3-51e174b799c7 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.769414 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425deca-d83f-468e-83d3-51e174b799c7 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.774118 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.774818 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.775106 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.775500 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.776238 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.778169 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.805606 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1452/2851] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:30 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:30.808970 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.819901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce3c22-dab0-4a34-a24a-0421dee81992 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.877730 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.878390 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.878673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.878980 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.879667 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.881581 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.902928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1400/2852] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:30 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:30.907025 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.920327 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850e31-127d-44eb-a931-5c5367944ddf admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.926032 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.926769 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.927002 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.927281 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.928007 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.929598 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.940774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1453/2853] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:30.944857 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.955281 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d3d68-668c-4ab4-b09e-f964059f8949 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.959901 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d4225-0e66-4700-83f8-95b81c4bf567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.960552 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4225-0e66-4700-83f8-95b81c4bf567 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.960835 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4225-0e66-4700-83f8-95b81c4bf567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.961113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d4225-0e66-4700-83f8-95b81c4bf567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:30.961836 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d4225-0e66-4700-83f8-95b81c4bf567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:30.963478 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d4225-0e66-4700-83f8-95b81c4bf567 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:30.973426 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1401/2854] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:30.977538 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:30.988562 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dadf3-cd83-484c-88ce-b669aae9d088 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:30.993257 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:30.994131 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:30.994417 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:30.994833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] PATH_INFO: `/v3/projects/b4119c0ac9804de6ab7749f8f9481e03/users/592481e6ad9a4febb50e419df50b327d/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.010142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4119c0ac9804de6ab7749f8f9481e03, user_id=592481e6ad9a4febb50e419df50b327d, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:31.012816 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:31.025351 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1454/2855] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:30 2022] PUT /identity/v3/projects/b4119c0ac9804de6ab7749f8f9481e03/users/592481e6ad9a4febb50e419df50b327d/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:31.088139 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b26d-9441-447a-a700-e458f5cecc71 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.088739 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b26d-9441-447a-a700-e458f5cecc71 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.088884 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b26d-9441-447a-a700-e458f5cecc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.118174 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3577b26d-9441-447a-a700-e458f5cecc71 None None] MFA Rules not processed for user `592481e6ad9a4febb50e419df50b327d`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:31.119423 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3577b26d-9441-447a-a700-e458f5cecc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:31.131689 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:31.184406 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1402/2856] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:31.195541 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:31.197346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:31.254774 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28ce55-52c6-4626-acce-28f548a5882b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:31.258439 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41be75-0cb9-4bb4-8ad9-52fafb6a92b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:31.259110 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41be75-0cb9-4bb4-8ad9-52fafb6a92b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.259391 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41be75-0cb9-4bb4-8ad9-52fafb6a92b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.259668 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41be75-0cb9-4bb4-8ad9-52fafb6a92b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.268271 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41be75-0cb9-4bb4-8ad9-52fafb6a92b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:31.269683 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41be75-0cb9-4bb4-8ad9-52fafb6a92b8 service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:31.278410 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1455/2857] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:31.297903 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577b26d-9441-447a-a700-e458f5cecc71 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:31.361440 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577b26d-9441-447a-a700-e458f5cecc71 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:31.366258 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:31.367142 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.367428 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.367707 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] PATH_INFO: `/v3/users/592481e6ad9a4febb50e419df50b327d` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.368895 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592481e6ad9a4febb50e419df50b327d)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:31.370860 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:31.416383 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592481e6ad9a4febb50e419df50b327d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:31.428584 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592481e6ad9a4febb50e419df50b327d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:31.429271 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592481e6ad9a4febb50e419df50b327d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:31.429896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592481e6ad9a4febb50e419df50b327d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:31.436673 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592481e6ad9a4febb50e419df50b327d'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:31.449753 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1403/2858] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:31 2022] DELETE /identity/v3/users/592481e6ad9a4febb50e419df50b327d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:31.454235 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.455264 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.455392 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.472338 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:31.473525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:31.531667 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1456/2859] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:31.542094 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:31.543560 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:31.584890 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:31.605300 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9b8db-e4b0-4cc7-8f87-277967e192e2 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:31.608974 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d99f0-5733-461f-99e9-24aa91739d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:31.609628 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d99f0-5733-461f-99e9-24aa91739d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.609910 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d99f0-5733-461f-99e9-24aa91739d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.610187 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d99f0-5733-461f-99e9-24aa91739d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.620043 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d99f0-5733-461f-99e9-24aa91739d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:31.621517 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d99f0-5733-461f-99e9-24aa91739d45 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:31.631086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1404/2860] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:31.902009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:31.903512 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:31.916273 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac199ff-cdd1-4b15-9590-8e623ce54a28 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:31.921057 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:31.922013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:31.922381 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:31.922746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] PATH_INFO: `/v3/projects/b4119c0ac9804de6ab7749f8f9481e03` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:31.924128 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4119c0ac9804de6ab7749f8f9481e03)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:31.926443 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:31.966809 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:31.976008 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4119c0ac9804de6ab7749f8f9481e03', 'request_id': 'req-1918547d-fe5f-4018-8344-17981dbba25d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:31.983346 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4119c0ac9804de6ab7749f8f9481e03', 'request_id': 'req-1918547d-fe5f-4018-8344-17981dbba25d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:31.989943 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4119c0ac9804de6ab7749f8f9481e03', 'request_id': 'req-1918547d-fe5f-4018-8344-17981dbba25d'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:32.000329 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] The token cache is being invalidate because project b4119c0ac9804de6ab7749f8f9481e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:32.000640 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:32.001265 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-1918547d-fe5f-4018-8344-17981dbba25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:32.003434 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1457/2861] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:31 2022] DELETE /identity/v3/projects/b4119c0ac9804de6ab7749f8f9481e03 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:32.009185 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52292e-ce15-4538-a4bd-9834dbcf4ceb None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.009480 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52292e-ce15-4538-a4bd-9834dbcf4ceb None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.009754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52292e-ce15-4538-a4bd-9834dbcf4ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.027329 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-ec52292e-ce15-4538-a4bd-9834dbcf4ceb None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:32.028510 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-ec52292e-ce15-4538-a4bd-9834dbcf4ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:32.086457 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1405/2862] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:32.094382 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e49c2-987c-4e70-85f8-b0a279ce71bb None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.094671 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e49c2-987c-4e70-85f8-b0a279ce71bb None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.094984 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e49c2-987c-4e70-85f8-b0a279ce71bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.112700 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-d88e49c2-987c-4e70-85f8-b0a279ce71bb None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:32.113885 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-d88e49c2-987c-4e70-85f8-b0a279ce71bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:32.122121 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1458/2863] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:32.126165 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52292e-ce15-4538-a4bd-9834dbcf4ceb None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:32.136337 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52292e-ce15-4538-a4bd-9834dbcf4ceb None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:32.140957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:32.141602 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.141887 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.142804 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.143556 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:32.143877 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:32.145474 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:32.156883 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1406/2864] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:32.161016 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e49c2-987c-4e70-85f8-b0a279ce71bb None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:32.170159 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e49c2-987c-4e70-85f8-b0a279ce71bb None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:32.174911 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:32.175552 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.175833 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.176115 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.176808 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:32.179352 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:32.204632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1459/2865] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:32 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:32.209267 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:32.219334 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352ea34-e7dd-478a-bf47-01a5e53ab8e7 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:32.274389 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:32.275086 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.275371 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.275644 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.276319 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:32.278222 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:32.297888 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1407/2866] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:32 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:32.302363 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:32.312488 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12362540-0fbe-4979-8298-812d9200fa3b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:32.317727 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:32.318372 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.318656 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.318966 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.319721 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:32.321303 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:32.331746 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1460/2867] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:32.335442 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:32.345866 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251c44e-f572-4245-b64a-98a701195db5 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:32.350435 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352947-65a9-41c8-9b4f-b8eafdc25dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:32.351113 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352947-65a9-41c8-9b4f-b8eafdc25dac admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.351393 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352947-65a9-41c8-9b4f-b8eafdc25dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.351668 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352947-65a9-41c8-9b4f-b8eafdc25dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.352384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352947-65a9-41c8-9b4f-b8eafdc25dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:32.353966 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352947-65a9-41c8-9b4f-b8eafdc25dac admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:32.364286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1408/2868] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:32.368150 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:32.378454 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a975d-cf5f-4c61-a3d2-18a795936a1b admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:32.383125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:32.383986 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.384300 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.384576 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] PATH_INFO: `/v3/projects/9380138a9c5c4f5a886d56ff71bd75ba/users/fda1759f34344a818cdae0e394d4c679/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.399138 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9380138a9c5c4f5a886d56ff71bd75ba, user_id=fda1759f34344a818cdae0e394d4c679, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:32.402679 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:32.416099 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1461/2869] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:32 2022] PUT /identity/v3/projects/9380138a9c5c4f5a886d56ff71bd75ba/users/fda1759f34344a818cdae0e394d4c679/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:32.427242 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e1bf-e661-4a74-855f-7a0258c597f6 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.427529 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e1bf-e661-4a74-855f-7a0258c597f6 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.427804 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68e1bf-e661-4a74-855f-7a0258c597f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.454455 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-3f68e1bf-e661-4a74-855f-7a0258c597f6 None None] MFA Rules not processed for user `fda1759f34344a818cdae0e394d4c679`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:32.455687 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-3f68e1bf-e661-4a74-855f-7a0258c597f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:32.488047 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:32.521193 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1409/2870] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:32.532681 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:32.534377 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:32.590654 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79118ca-61b5-43ae-b7bf-584dfa1ea977 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:32.594334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0330e8-f57e-47d2-8784-2f306785c093 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40a1f11c5cd4b48be27dd1a0f48bdc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:32.595059 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0330e8-f57e-47d2-8784-2f306785c093 service glance] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:32.595850 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0330e8-f57e-47d2-8784-2f306785c093 service glance] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:32.596125 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0330e8-f57e-47d2-8784-2f306785c093 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:32.604367 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0330e8-f57e-47d2-8784-2f306785c093 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:32.605777 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0330e8-f57e-47d2-8784-2f306785c093 service glance] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:32.615428 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1462/2871] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 10:34:42.518838 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=12 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:42.610623 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:51.212916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e1bf-e661-4a74-855f-7a0258c597f6 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:51.275712 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68e1bf-e661-4a74-855f-7a0258c597f6 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:51.280290 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:51.281146 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:51.281427 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:51.281698 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] PATH_INFO: `/v3/users/fda1759f34344a818cdae0e394d4c679` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:51.282907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda1759f34344a818cdae0e394d4c679)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:51.284873 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:51.330101 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda1759f34344a818cdae0e394d4c679'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.343684 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda1759f34344a818cdae0e394d4c679'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.344352 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda1759f34344a818cdae0e394d4c679'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.344957 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda1759f34344a818cdae0e394d4c679'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.351923 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda1759f34344a818cdae0e394d4c679'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.364353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1410/2872] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:51 2022] DELETE /identity/v3/users/fda1759f34344a818cdae0e394d4c679 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 10:34:51.368991 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:51.369491 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:51.369602 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:51.386740 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:51.387953 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:51.447001 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1463/2873] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:51.457064 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:51.458460 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:51.517871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd72a4-6b57-40e7-88d5-44cf9e5b7005 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:51.521492 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dc4e8-5567-4f37-bf13-b7614fce459f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:51.522131 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dc4e8-5567-4f37-bf13-b7614fce459f service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:51.522410 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dc4e8-5567-4f37-bf13-b7614fce459f service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:51.523254 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dc4e8-5567-4f37-bf13-b7614fce459f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:51.532118 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dc4e8-5567-4f37-bf13-b7614fce459f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:51.533476 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dc4e8-5567-4f37-bf13-b7614fce459f service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:51.542899 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1411/2874] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:51.807205 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:51.809294 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:51.822061 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e3bb-fc92-4d4a-93af-e2738e4136ad None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:51.827153 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:51.828013 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:51.828321 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:51.828619 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] PATH_INFO: `/v3/projects/9380138a9c5c4f5a886d56ff71bd75ba` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:51.829902 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9380138a9c5c4f5a886d56ff71bd75ba)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:51.831760 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:51.879340 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9380138a9c5c4f5a886d56ff71bd75ba', 'request_id': 'req-618e655f-4e3b-4261-b5d3-331ac2b65a60'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.887845 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9380138a9c5c4f5a886d56ff71bd75ba', 'request_id': 'req-618e655f-4e3b-4261-b5d3-331ac2b65a60'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.894069 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9380138a9c5c4f5a886d56ff71bd75ba', 'request_id': 'req-618e655f-4e3b-4261-b5d3-331ac2b65a60'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.907551 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] The token cache is being invalidate because project 9380138a9c5c4f5a886d56ff71bd75ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:34:51.909343 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.910009 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-618e655f-4e3b-4261-b5d3-331ac2b65a60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:34:51.913858 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1464/2875] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:34:51 2022] DELETE /identity/v3/projects/9380138a9c5c4f5a886d56ff71bd75ba => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:51.918871 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d3edf-f284-4707-9177-65c87fc52636 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:51.919162 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d3edf-f284-4707-9177-65c87fc52636 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:51.919462 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d3edf-f284-4707-9177-65c87fc52636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:51.936879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-1c1d3edf-f284-4707-9177-65c87fc52636 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:51.938144 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-1c1d3edf-f284-4707-9177-65c87fc52636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:51.954852 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:51.998879 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1412/2876] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:52.006399 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d171554-76b2-4179-8037-dcd4c2a99b87 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.006792 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d171554-76b2-4179-8037-dcd4c2a99b87 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.007661 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d171554-76b2-4179-8037-dcd4c2a99b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.026171 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-1d171554-76b2-4179-8037-dcd4c2a99b87 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:52.027427 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-1d171554-76b2-4179-8037-dcd4c2a99b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:52.035233 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1465/2877] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:34:52.039353 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d3edf-f284-4707-9177-65c87fc52636 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.049157 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d3edf-f284-4707-9177-65c87fc52636 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.053776 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.054384 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.054666 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.054977 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.055704 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 10:34:52.056011 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.057608 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.069302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1413/2878] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 30 10:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 10:34:52.073969 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d171554-76b2-4179-8037-dcd4c2a99b87 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.083451 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d171554-76b2-4179-8037-dcd4c2a99b87 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.088646 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.089287 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.089572 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.089846 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] PATH_INFO: `/v3/projects` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.090540 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.092459 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.117455 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1466/2879] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 30 10:34:52 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 10:34:52.121604 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.131467 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14704ef-e599-4586-8b59-47c1816b4d77 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.187322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.188019 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.188302 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.188578 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] PATH_INFO: `/v3/users` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.189257 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.191200 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.211928 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1414/2880] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 30 10:34:52 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 10:34:52.216060 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.226220 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4495b-2fab-4b91-bcc3-8cda7257dafd admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.230848 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.231525 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.231805 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.232080 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.232801 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.234387 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.246773 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1467/2881] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 10:34:52.250731 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.261283 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520f289-37a9-42b1-9076-2036ee68a459 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.266002 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bbae1-07af-4f54-b047-76ce2233c0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.266655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bbae1-07af-4f54-b047-76ce2233c0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.266994 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bbae1-07af-4f54-b047-76ce2233c0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.267268 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bbae1-07af-4f54-b047-76ce2233c0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.268013 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bbae1-07af-4f54-b047-76ce2233c0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.269601 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bbae1-07af-4f54-b047-76ce2233c0ec admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.279996 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1415/2882] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 30 10:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 10:34:52.283974 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.293843 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14a72-5c22-4f1d-bbd6-537332ed8403 admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.299430 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.300331 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.300622 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.300932 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] PATH_INFO: `/v3/projects/95cefe491189461b8265727b400ee179/users/d4f630cb595b4961aaba01b79fa51407/roles/9987e14f9f4744858d584c8867b2a56c` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.315349 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cefe491189461b8265727b400ee179, user_id=d4f630cb595b4961aaba01b79fa51407, role_id=9987e14f9f4744858d584c8867b2a56c)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.317900 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.331529 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1468/2883] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 30 10:34:52 2022] PUT /identity/v3/projects/95cefe491189461b8265727b400ee179/users/d4f630cb595b4961aaba01b79fa51407/roles/9987e14f9f4744858d584c8867b2a56c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:34:52.342754 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a863e0-49e0-4477-9e15-19f2cbe7ced8 None None] REQUEST_METHOD: `POST` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.343045 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a863e0-49e0-4477-9e15-19f2cbe7ced8 None None] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.343322 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a863e0-49e0-4477-9e15-19f2cbe7ced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.369441 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.auth.core [None req-f0a863e0-49e0-4477-9e15-19f2cbe7ced8 None None] MFA Rules not processed for user `d4f630cb595b4961aaba01b79fa51407`. Rule list: `[]` (Enabled: `True`). {{(pid=80026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:34:52.370642 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-f0a863e0-49e0-4477-9e15-19f2cbe7ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:52.434163 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1416/2884] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 10:34:52.445880 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:52.447687 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:34:52.469358 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:52.506158 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab06a7-e2be-4a3f-8f7b-524fac898c7c admin admin] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:52.510375 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3ce2b-9fe2-4bc7-90e6-b7dade78201a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5eb306a63e14e57a10d468a4aa65db0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:52.511053 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3ce2b-9fe2-4bc7-90e6-b7dade78201a service cinder] REQUEST_METHOD: `GET` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:52.511356 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3ce2b-9fe2-4bc7-90e6-b7dade78201a service cinder] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:52.511632 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3ce2b-9fe2-4bc7-90e6-b7dade78201a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:52.519771 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3ce2b-9fe2-4bc7-90e6-b7dade78201a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:52.521187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3ce2b-9fe2-4bc7-90e6-b7dade78201a service cinder] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:34:52.529835 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1469/2885] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:34:59.893619 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a863e0-49e0-4477-9e15-19f2cbe7ced8 None None] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:34:59.912811 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:34:59.959929 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a863e0-49e0-4477-9e15-19f2cbe7ced8 None None] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:34:59.967625 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:34:59.968617 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:34:59.968935 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:34:59.969253 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] PATH_INFO: `/v3/users/d4f630cb595b4961aaba01b79fa51407` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:34:59.970655 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f630cb595b4961aaba01b79fa51407)` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:34:59.972907 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:35:00.026944 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f630cb595b4961aaba01b79fa51407'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.042536 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f630cb595b4961aaba01b79fa51407'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.043432 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f630cb595b4961aaba01b79fa51407'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.044379 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f630cb595b4961aaba01b79fa51407'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.052960 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.notifications [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f630cb595b4961aaba01b79fa51407'} {{(pid=80026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.069936 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1417/2886] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 30 10:34:59 2022] DELETE /identity/v3/users/d4f630cb595b4961aaba01b79fa51407 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:35:00.075895 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] REQUEST_METHOD: `POST` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:35:00.076371 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:35:00.076577 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:35:00.094605 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.auth.core [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] MFA Rules not processed for user `810ff4bb01dd49c79c0fe9e258d450e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80025) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 10:35:00.095837 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:35:00.158354 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1470/2887] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 30 10:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 10:35:00.168343 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:35:00.169955 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:35:00.245661 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b97c81-bea3-4612-94a2-4eca02c67b98 admin admin] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:35:00.250275 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c11a44c395ae45fcba4e0c0fe08695c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:35:00.251161 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:35:00.251532 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:35:00.251896 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:35:00.263916 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:35:00.265812 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:35:00.278554 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1418/2888] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:35:00.550267 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] Authenticating user token {{(pid=80025) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:35:00.552142 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.fernet_utils [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80025) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:35:00.568710 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9948-7282-46b2-a416-cd8f52856da4 None None] Validating token access rules against request {{(pid=80025) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:35:00.572473 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '810ff4bb01dd49c79c0fe9e258d450e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9982519b09d14f298a1a1f477137a258', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80025) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:35:00.573334 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:35:00.573614 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:35:00.573892 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] PATH_INFO: `/v3/projects/95cefe491189461b8265727b400ee179` {{(pid=80025) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:35:00.575476 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cefe491189461b8265727b400ee179)` {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:35:00.577325 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] RBAC: Authorization granted {{(pid=80025) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:35:00.628200 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cefe491189461b8265727b400ee179', 'request_id': 'req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.635570 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cefe491189461b8265727b400ee179', 'request_id': 'req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.642021 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cefe491189461b8265727b400ee179', 'request_id': 'req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4'} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.652787 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] The token cache is being invalidate because project 95cefe491189461b8265727b400ee179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80025) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 10:35:00.653068 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.653718 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG keystone.notifications [None req-21e21c6f-c58c-4f14-8352-0c26d4a9bcf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80025) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 10:35:00.655297 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: [pid: 80025|app: 0|req: 1471/2889] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 30 10:35:00 2022] DELETE /identity/v3/projects/95cefe491189461b8265727b400ee179 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 10:35:10.272819 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:35:10.649187 dv-cinder-826608-4-iscsi devstack@keystone.service[80025]: DEBUG dbcounter [-] [80025] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 10:36:04.064297 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] Authenticating user token {{(pid=80026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 10:36:04.065692 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:04.155148 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db97be-5810-4617-b60e-9948ae7c3887 service neutron] Validating token access rules against request {{(pid=80026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 10:36:04.213545 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985332ca-63e0-44bf-8e2c-9262b297c2f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '888cdfc6fbf94f02bd671b67280d767f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1ef6188696e4bcf8810f1ba4ddbfe21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 10:36:04.214195 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985332ca-63e0-44bf-8e2c-9262b297c2f3 service placement] REQUEST_METHOD: `GET` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 10:36:04.214481 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985332ca-63e0-44bf-8e2c-9262b297c2f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 10:36:04.214789 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985332ca-63e0-44bf-8e2c-9262b297c2f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 10:36:04.216593 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.fernet_utils [None req-985332ca-63e0-44bf-8e2c-9262b297c2f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 10:36:04.227750 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985332ca-63e0-44bf-8e2c-9262b297c2f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 10:36:04.229339 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985332ca-63e0-44bf-8e2c-9262b297c2f3 service placement] RBAC: Authorization granted {{(pid=80026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 10:36:04.239286 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: [pid: 80026|app: 0|req: 1419/2890] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 30 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 10:36:14.234965 dv-cinder-826608-4-iscsi devstack@keystone.service[80026]: DEBUG dbcounter [-] [80026] Writing DB stats keystone:SELECT=67 {{(pid=80026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}